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Preface 



The abstracts and papers in this volume were presented at the Fifth Annual 
International Computing and Combinatorics Conference (COCOON ’99), which 
was held in Tokyo, Japan from July 26 to 28, 1999. The topics cover most aspects 
of theoretical computer science and combinatorics pertaining to computing. 

In response to the call for papers, 88 high-quality extended abstracts were 
submitted internationally, of which 46 were selected for presentation by the pro- 
gram committee. Every submitted paper was reviewed by at least three program 
committee members. Many of these papers represent reports on continuing re- 
search, and it is expected that most of them will appear in a more polished and 
complete form in scientific journals. In addition to the regular papers, this vol- 
ume contains abstracts of two invited plenary talks by Prablrakar Raghavan and 
Seinosuke Toda. The conference also included a special talk by Kurt Melrlhorn 
on LEDA (Library of Efficient Data types and Algorithms). 

The Hao Wang Award (inaugurated at COCOON ’97) is given to honor the 
paper judged by the program committee to have the greatest scientific merit. 
The recipients of the Hao Wang Award 1999 were Hiroshi Nagamochi and Toslri- 
hide Ibaraki for their paper “An Approximation for Finding a Smallest 2-Edge- 
Connected Subgraph Containing a Specified Spanning Tree” . 

We wish to thank all who have made this meeting possible: the authors for 
submitting papers, the program committee members and external referees for 
their excellent work in reviewing the papers, the sponsors, the local organizers, 
ACM SIGACT and the University of Tokyo for handling electronic submissions, 
and Springer- Verlag for their support and assistance. 
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The Web as a Graph: Measurements, Models, 

and Methods 



Jon M. Kleinberg 1 , Ravi Kumar 2 , Prabhakar Raghavan 2 , 

Sridlrar Rajagopalan 2 , and Andrew S. Tomkins 2 

1 Department of Computer Science, Cornell University, Ithaca, NY 14853. 

2 IBM Almaden Research Center K53/B1, 650 Harry Road, San Jose CA 95120. 



Abstract. The pages and hyperlinks of the World-Wide Web may be 
viewed as nodes and edges in a directed graph. This graph is a fascinating 
object of study: it has several hundred million nodes today, over a billion 
links, and appears to grow exponentially with time. There are many rea- 
sons — mathematical, sociological, and commercial — for studying the 
evolution of this graph. In this paper we begin by describing two algo- 
rithms that operate on the Web graph, addressing problems from Web 
search and automatic community discovery. We then report a number of 
measurements and properties of this graph that manifested themselves 
as we ran these algorithms on the Web. Finally, we observe that tradi- 
tional random graph models do not explain these observations, and we 
propose a new family of random graph models. These models point to 
a rich new sub-field of the study of random graphs, and raise questions 
about the analysis of graph algorithms on the Web. 



1 Overview 

Few events in the history of computing have wrought as profound an influence 
on society as the advent and growth of the World-Wide Web. For the first time, 
millions — soon to be billions — of individuals are creating, annotating and 
exploiting hyperlinked content in a distributed fashion. A particular Web page 
might be authored in any language, dialect, or style by an individual with any 
background, culture, motivation, interest, and education; might range from a 
few characters to a few hundred thousand; might contain truth, falsehood, lies, 
propaganda, wisdom, or sheer nonsense; and might point to none, few, or several 
other Web pages. The hyperlinks of the Web endow it with additional structure; 
and the network of these links is rich in latent information content. Our focus 
in this paper is on the directed graph induced by the hyperlinks between Web 
pages; we refer to this as the Web graph. 

For our purposes, nodes represent static html pages and hyperlinks represent 
directed edges. Recent estimates Pj suggest that there are several hundred mil- 
lion nodes in the Web graph; this quantity is growing by a few percent a month. 
The average node has roughly seven hyperlinks (directed edges) to other pages, 
making for a total of several billion hyperlinks in all. 
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There are several reasons for studying the Web graph. The structure of 
this graph has already led to improved Web search 1618121 129] , more accurate 
topic-classification algorithms El and has inspired algorithms for enumerating 
emergent cyber-communities 12.' > I . The hyperlinks themselves represent a fecund 
source of sociological information. Beyond the intrinsic interest of the structure 
of the Web graph, measurements of the graph and of the behavior of users as 
they traverse the graph, are of growing commercial interest. 



1.1 Guided tour of this paper 

In Section 0 we review two algorithms that have been applied to the Web 
graph: Kleinberg’s HITS method m and the enumeration of certain bipartite 
cliques E33- We have chosen these algorithms here because they are both driven 
by the presence of certain structures in the Web graph. These structures (which 
we will detail below) appear to be a fundamental by-product of the manner in 
which Web content is created. 

In Section 0 we summarize a number of measurements we have made on the 
entire Web graph, and on particular local subgraphs of interest. We show, for 
instance, that the in- and out-degrees of nodes follow Zipfian (inverse polyno- 
mial) distributions II12I17I26I31| . This and other measurements of the frequency 
of occurrence of certain structures suggest that traditional random graph models 
such as G n ,p 0 are likely to do a poor job of modeling the Web graph. 

In Section 0 we lay down a framework for a class of random graph models, 
and give evidence that at least some of our observations about the Web (for 
instance, the degree distributions) can be established in these models. A notable 
aspect of these models is that they embody some version of a copying process: 
we add links to a node v by picking a random (other) node u in the graph, and 
copying some links from u to v (i.e., we add edges from v to some of the nodes 
that u points to). Such copying operations seem to be fundamental both to the 
process of content-creation on the Web and to the explanation of the statistics 
we have observed. One consequence is that the mathematical analysis of these 
graph models promises to be far harder than in traditional graph models in 
which the edges emanating from a node are drawn independently. 

We conclude in Section 0 with a number of directions for further work. 



1.2 Related work 

Analysis of the structure of the Web graph has been used to enhance the quality 
of Web search TOJ3ZI1211. The topics of pages pointed to by a Web page can 
be used to improve the accuracy of determining the (unknown) topic of this page 
in the setting of supervised classification El- 

Statistical analysis of the structure of the academic citation graph has been 
the subject of much work in the Sociometrics community. As we discuss below, 
Zipf distributions seem to characterize Web citation frequency. Interestingly, the 
same distributions have also been observed for citations in the academic litera- 
ture. This fact, known as Lotka’s law , was demonstrated by Lotka in 1926 m- 
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Gilbert [TJj presents a probabilistic model explaining Lotka’s law, which is sim- 
ilar in spirit to our proposal, though different in details and application. The 
field of bibliometrics IHITH has studied phenomena in citation; some of these 
insights have been applied to the Web as well m- 

A view of the Web as a semi-structured database has been advanced by 
many authors. In particular, LORE [I] and WebSQL m use graph-theoretic 
and relational views of the Web respectively. These views support structured 
query interfaces to the Web (Lorel Q and WebSQL El) that are evocative of 
and similar to SQL. An advantage of this approach is that many interesting 
queries can be expressed as simple expressions in the very powerful SQL syntax. 
The corresponding disadvantage is that the generality comes with an associated 
computational cost which can be prohibitive until we develop query optimizers 
for Web graph computations that similar to those available for relational data. 
LORE and WebSQL are but two examples of projects in this space. Some other 
examples are W3QS [221, WebQuery (Sj, Weblog |Z3], and ParaSite/Squeal (22) ■ 

Traditional data mining research (see for instance Agrawal and Srikant |2j) 
focuses largely on algorithms for finding association rules and related statistical 
correlation measures in a given dataset. However, efficient methods such as a 
priori |2| or even more general methodologies such as query flocks BDJ. do not 
scale to the numbers of “items” (pages) in the Web graph. This number is already 
two to three orders of magnitude more than the number of items in a typical 
market basket analysis. 

The work of Mendelzon and Wood 129 is an instance of structural methods 
in mining. They argue that the traditional SQL query interface to databases is 
inadequate in its power to specify several structural queries that are interesting 
in the context of the Web. They provide the example of path connectivity be- 
tween nodes subject to some constraints on the sequence of edges on the path 
(expressible in their case as a regular expression). They describe G + , a language 
with greater expressibility than SQL for graph queries. 



2 Algorithms 

We have observed the following recurrent phenomenon on the Web. For any 
particular topic, there tend to be a set of “authoritative” pages focused on the 
topic, and a set of “hub” pages, each containing links to useful, relevant pages on 
the topic. This observation motivated the development of two algorithms which 
we describe below. The first is a search algorithm that distils high-quality pages 
for a topic query ('Section l2.ll) . and the second enumerates all topics that are 
represented on the Web in terms of suitably dense sets of such hub/authority 
pages ('Section likiil) . 

2.1 The HITS algorithm 

Beginning with a search topic, specified by one or more query terms, Kleinberg’s 
HITS algorithm [ 2 1 j applies two main steps: a sampling step, which constructs 



4 



J.M. Kleinberg et al. 



a focused collection of several thousand Web pages likely to be rich in relevant 
authorities; and a weight-propagation step, which determines numerical estimates 
of hub and authority scores by an iterative procedure. The pages with the highest 
scores are returned as hubs and authorities for the search topic. 

Any subset S of nodes induces a subgraph containing all edges that connect 
two nodes in S. The first step of the HITS algorithm constructs a subgraph 
expected to be rich in relevant, authoritative pages, in which it will search for 
hubs and authorities. To construct this subgraph, the algorithm first uses key- 
word queries to collect a root set of, say, 200 pages from a traditional index-based 
search engine. This set does not necessarily contain authoritative pages; how- 
ever, since many of these pages are presumably relevant to the search topic, 
one can expect some to contain links to prominent authorities, and others to be 
linked to by prominent hubs. The root set is therefore expanded into a base set 
by including all pages that are linked to by pages in the root set, and all pages 
that link to a page in the root set (up to a designated size cut-off). This follows 
the intuition that the prominence of authoritative pages is typically due to the 
endorsements of many relevant pages that are not, in themselves, prominent. We 
restrict our attention to this base set for the remainder of the algorithm; this 
set typically contains roughly 1000-3000 pages, and that (hidden) among these 
are a large number of pages that one would subjectively view as authoritative 
for the search topic. 

We begin with one modification to the subgraph induced by the base set. 
Links between two pages on the same Web site very often serve a purely nav- 
igational function, and typically do not represent conferral of authority. We 
therefore delete all such links from the subgraph induced by the base set, and 
apply the remainder of the algorithm to this modified subgraph. 

Good hubs and authorities can be extracted from the base set by giving a 
concrete numerical definition to the intuitive notions of hub and authority from 
the beginning of this section. The algorithm associates a non-negative authority 
weight x p and a non-negative hub weight y p with each page p £ V. We will only 
be interested in the relative values of these weights, not their actual magnitudes; 
so in the manipulation of the weights, we apply a normalization to prevent the 
weights from overflowing. (The actual choice of normalization does not affect the 
results; we maintain the invariant that the squares of all weights sum to 1.) A 
page p with a large weight x p (resp. y p ) will be viewed as a “better” authority 
(resp. hub). Since we do not impose any a priori estimates, all x- and y - values 
are set to a uniform constant initially. As will be seen later, however, the final 
results are essentially unaffected by this initialization. 

The authority and hub weights are updated as follows. If a page is pointed 
to by many good hubs, we would like to increase its authority weight; thus for 
a page p, the value of x p is updated to be to be the sum of y q over all pages q 
that link to p: 



x p = 



Y V*’ 



q such that q— 



(i) 
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where the notation q — > p indicates that q links to p. In a strictly dual fashion, 
if a page points to many good authorities, its hub weight is increased via 

Up = x q- (2) 

q such that p — >q 

There is a more compact way to write these updates, and it turns out to shed 
more light on the mathematical process. Let us number the pages {1,2, . . . , n} 
and define their adjacency matrix A to be the n x n matrix whose (i,j) th entry 
is equal to 1 if page i links to page j, and is 0 otherwise. Let us also write 
the set of all a> values as a vector x = (x\, X 2 , ■ ■ ■ , x n ), and similarly define 
V = (yij 2 / 2 , • • • , Vn)- Then the update rule for x can be written as x *— A T y 
and the update rule for y can be written as y <— Ax. Unwinding these one step 
further, we have 



A T y <- A t Ax = (A t A)x 


( 3 ) 


Ax <— AA T y = ( AA T )y . 


( 4 ) 



Thus the vector x after multiple iterations is precisely the result of applying the 
power iteration technique to A T A — we multiply our initial iterate by larger and 
larger powers of A T A — and a standard result in linear algebra tells us that this 
sequence of iterates, when normalized, converges to the principal eigenvector of 
A T A. Similarly, the sequence of values for the normalized vector y converges to 
the principal eigenvector of AA T . (See the book by Golub and Van Loan (dj for 
background on eigenvectors and power iteration.) 

In fact, power iteration will converge to the principal eigenvector for any 
“non-degenerate” choice of initial vector — in our case, for example, for any 
vector all of whose entries are positive. This says that the hub and authority 
weights computed are truly an intrinsic feature of the collection of linked pages, 
not an artifact of the choice of initial weights or the tuning of arbitrary param- 
eters. Intuitively, the pages with large weights represent a very “dense” pattern 
of linkage, from pages of large hub weight to pages of large authority weight. 
This type of structure — a densely linked community of thematically related 
hubs and authorities — will be the motivation underlying Section below. 

Finally, the output of HITS algorithm for the given search topic is a short 
list consisting of the pages with the largest hub weights and the pages with the 
largest authority weights. Thus the algorithm has the following interesting fea- 
ture: after using the query terms to collect the root set, the algorithm completely 
ignores textual content thereafter. In other words, HITS is a purely link-based 
computation once the root set has been assembled, with no further regard to the 
query terms. Nevertheless, HITS provides surprisingly good search results for a 
wide range of queries. For instance, when tested on the sample query “search 
engines”, the top authorities returned by HITS were Yahoo!, Excite, Magellan, 
Lycos, and AltaVista — even though none of these pages (at the time of the 
experiment) contained the phrase “search engines.” 
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In subsequent work mm . the HITS algorithm has been generalized by 
modifying the entries of A so that they are no longer boolean. These modifi- 
cations take into account the content of the pages in the base set, the internet 
domains in which they reside, and so on. Nevertheless, most of these modifica- 
tions retain the basic power iteration process and the interpretation of hub and 
authority scores as components of a principal eigenvector, as above. 

2.2 Trawling the Web for cyber-communities 

In this section we turn to a second algorithm developed for the Web graph. In 
contrast to HITS, which is a search algorithm designed to find high-quality pages 
about a fixed topic, the trawling algorithm described below seeks to enumerate 
all topics (under a certain definition), and therefore processes the entire Web 
graph. 

We begin with a more concrete definition of the types of topic we wish to 
enumerate. Recall that a complete bipartite clique K it j is a graph in which every 
one of i nodes has an edge directed to each of j nodes (in the following treatment 
it is simplest to think of the first i nodes as being distinct from the second j: 
in fact this is not essential to our algorithms or models). We further define a 
bipartite core Cij to be a graph on i + j nodes that contains at least one Kj 3 
as a subgraph. The intuition motivating this notion is the following: on any 
sufficiently well represented topic on the Web, there will (for some appropriate 
values of i and j) be a bipartite core in the Web graph. Figure Q] illustrates an 
instance of a 64,3 in which the four nodes on the left have hyperlinks to the 
home pages of three major commercial aircraft manufacturers. Such a subgraph 




of the Web graph would be suggestive of a “cyber-community” of aficionados of 
commercial aircraft manufacturers who create hub-like pages like the four on the 
left side of Figure |T| These pages co-cite the authoritative pages on the right. 
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Loosely speaking, such a community emerges in the Web graph when many (hub) 
pages link to many of the same (authority) pages. In most cases, the hub pages 
in such communities may not co-cite all the authoritative pages for that topic. 
Nevertheless, it is tempting to subscribe to the following weaker hypothesis: 
every such community will contain a bipartite core Cij for non-trivial values of 
i and j. Turning this around, we could attempt to identify a large fraction of 
cyber-communities by enumerating all the bipartite cores in the Web for, say 
i = j = 3; we call this process trawling. Why these choices of i and j ? Might it 
not be that for such small values of i and j , we discover a number of coincidental 
co-citations, which do not truly correspond to communities? 

In fact, in our experiment ( 23 | we enumerated Cij ’ s for values of i ranging 
from 3 to 9, for j ranging from 3 to 20. The results suggest that (1) the Web 
graph has several hundred thousand such cores, and (2) it appears that only 
a minuscule fraction of these are coincidences — the vast majority do in fact 
correspond to communities with a definite topic focus. Below we give a short 
description of this experiment, followed by some of the principal findings. 

From an algorithmic perspective, the naive “search” algorithm for enumer- 
ation suffers from two fatal problems. First, the size of the search space is far 
too large — using the naive algorithm to enumerate all bipartite cores with two 
Web pages pointing to three pages would require examining approximately lO 40 
possibilities on a graph with 10 8 nodes. A theoretical question (open as far as 
we know): does the work on fixed-parameter intractability m imply that we 
cannot - in the worst case - improve on naive enumeration for bipartite cores? 
Such a result would argue that algorithms that are provably efficient on the Web 
graph must exploit some feature that distinguishes it from the “bad” inputs for 
fixed-parameter intractability. Second, and more practically, the algorithm re- 
quires random access to edges in the graph, which implies that a large fraction 
of the graph must effectively reside in main memory to avoid the overhead of 
seeking a disk on every edge access. 

We call our algorithmic methodology the elimination-generation paradigm. 
An algorithm in the elimination/generation paradigm performs a number of se- 
quential passes over the Web graph, stored as a binary relation. During each 
pass, the algorithm writes a modified version of the dataset to disk for the next 
pass. It also collects some metadata which resides in main memory and serves 
as state during the next pass. Passes over the data are interleaved with sort 
operations, which change the order in which the data is scanned, and constitute 
the bulk of the processing cost. We view the sort operations as alternately or- 
dering directed edges by source and by destination, allowing us alternately to 
consider out-edges and in-edges at each node. During each pass over the data, 
we interleave elimination operations and generation operations, which we now 
detail. 

Elimination. There are often easy necessary (though not sufficient) conditions 
that have to be satisfied in order for a node to participate in a subgraph of 
interest to us. Consider the example of Chq’s. Any node with in-degree 3 or 
smaller cannot participate on the right side of a C 4,4. Thus, edges that are 
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directed into such nodes can be pruned from the graph. Likewise, nodes with 
out-degree 3 or smaller cannot participate on the left side of a C4.4. We refer to 
these necessary conditions as elimination filters. 

Generation. Generation is a counterpoint to elimination. Nodes that barely qual- 
ify for potential membership in an interesting subgraph can easily be verified to 
either belong in such a subgraph or not. Consider again the example of a C4.4. 
Let u be a node of in-degree exactly 4. Then, u can belong to a C4 4 if and only if 
the 4 nodes that point to it have a neighborhood intersection of size at least 4. It 
is possible to test this property relatively cheaply, even if we allow the in-degree 
to be slightly more than 4. We define a generation filter to be a procedure that 
identifies barely-qualifying nodes, and for all such nodes, either outputs a core 
or proves that such a core cannot exist. If the test embodied in the generation 
filter is successful, we have identified a core. Further, regardless of the outcome, 
the node can be pruned since all potential interesting cores containing it have 
already been enumerated. 

Note that if edges appear in an arbitrary order, it is not clear that the 
elimination filter can be easily applied. If, however, the edges are sorted by 
source (resp. destination), it is clear that the outlink (resp. inlink) filter can be 
applied in a single scan. Details of how this can be implemented with few passes 
over the data (most of which is resident on disk, and must be streamed through 
main memory for processing) may be found in 123 ) . 

After an elimination/generation pass, the remaining nodes have fewer neigh- 
bors than before in the residual graph, which may present new opportunities 
during the next pass. We can continue to iterate until we do not make signifi- 
cant progress. Depending on the filters, one of two things could happen: (1) we 
repeatedly remove nodes from the graph until nothing is left, or (2) after several 
passes, the benefits of elimination/generation “tail off” as fewer and fewer nodes 
are eliminated at each phase. In our trawling experiments, the latter phenomenon 
dominates. 

Why should such algorithms run fast? We make a number of observations 
about their behavior: 

1. The in/out-degree of every node drops monotonically during each elimina- 
tion/generation phase. 

2. During each generation test, we either eliminate a node u from further con- 
sideration (by developing a proof that it can belong to no core) , or we output 
a subgraph that contains u. Thus, the total work in generation is linear in 
the size of the Web graph plus the number of cores enumerated, assuming 
that each generation test runs in constant time. 

3. In practice, elimination phases rapidly eliminate most nodes in the Web 
graph. A complete mathematical analysis of iterated elimination is beyond 
the scope of this paper, and requires a detailed understanding of the kinds 
of random graph models we propose in Section 0 

Kumar et al. [22. report trawling a copy of the Web graph derived from a 
Web crawl obtained from Alexa, inc. This experiment generated well over 100,000 
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bipartite cores Note that since these cores are the result of enumeration 
(rather than querying), they lack any form of context or topic with which one can 
tag them. Indeed, as noted in m , the only certain way of determining whether 
a core is coincidental or real is manual inspection. The results of |23| suggest 
that over 90% of the cores enumerated in this experiment are not coincidental, 
but in fact bear definite themes. 

We conclude this section by remarking that bipartite cores are not necessar- 
ily the only subgraph enumeration problems that are interesting in the setting of 
the Web graph. The subgraphs corresponding to Webrings look like bidirectional 
stars, in which there is a central page with links to and from a number of “spoke” 
pages. Cliques, and directed trees, are other interesting structures for enumera- 
tion. Devising general paradigms for such enumeration problems appears to be 
difficult, unless one understands and exploits the peculiarities of the Web graph. 
The next two sections address this issue. 

3 Measurements 

In the course of experiments with the algorithms of Section 0 we were able to 
study many of the local properties of the Web graph. In this section we survey 
these observations, and point out that traditional random graph models like G n ,p 
would do a poor job of explaining them. 



3.1 Degree distributions 

We begin with the in- and out-degrees of nodes in the Web graph. Figure Q 
is a log-log plot (with the x-axis negated) of the in-degree distribution. The 
plot suggests that the probability that a node has degree i is proportional to 
1 /*“, where a is approximately 2. Such a Zipfian distribution 15D cannot arise 
in a model such as G n ,p , where (due to the superposition of Bernoulli trials) 
in-degrees exhibit either a Poisson or a binomial distribution. Consider next the 
out-degree distribution (Figure 0- Again the distribution looks faintly Zipfian, 




Fig. 2. In-degree distribution. 
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although here the variations seem larger. The average out-degree we observed is 
about 7.2. A natural question now arises: if Gn,p will not result in such Zipfian 
distributions, what is a natural stochastic process that will? We provide a partial 
answer in Section 0 



3.2 Number of bipartite cores 

We turn next to the distribution of cores C h j, based on the numbers discovered 
in the trawling experiment Figures El and O depict these distributions as 
functions of i and j: these quantities are from a crawl of the Web that is roughly 



The number of C_i j's drops exponentially in i 
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Fig. 4. Core distribution by left side. 



two years old, obtained from Alexa, inc. The number of Web pages in this crawl is 
roughly 100 million. How does this compare with the numbers one might observe 
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The number of CJj's is inverse polynomial in j 
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Fig. 5. Core distribution by right side. 



in a graph generated using Q n ,pi say for np = 7.2 (our observed out-degree)? A 
simple calculation yields that the expected number of Cij's is 




which is negligible for ij > i + j. Clearly, one cannot explain the multitude of 
Cj j ’s in the Web graph using Q n , p \ once again, we hope that the models we 
propose in Section El can explain these observations. 

3.3 Connectivity of local subgraphs 

We now consider some relating to the connectivity of local subgraphs of the 
Web graph. We begin by fixing our set of local subgraphs to be the base sets 
arising in the HITS algorithm of Section |2 To recapitulate, we begin with c 
nodes obtained by issuing a keyword query to a text-based search engine. We 
then expand this root set to the base set by adding any page linked to by a page 
in the root set, and any page linking to a page in the root set (up to a cut-off of 
d pages per element of the root set). In experiments, we have applied this with 
c, the size of the root set, equal to 200; and d , the cut-off, equal to 50. As above, 
the resulting base set typically consists of roughly 1000 to 3000 pages, and since 
we wish to focus on cross-site links we discard links between two pages within 
the same site. 

We now ask how well-connected these local subgraphs are. We will view G 
primarily as a directed graph, but we also define the undirected version G u 
obtained by ignoring the direction of all edges. 

A collection of graphs constructed in this way for an ensemble of fifty sample 
query terms reveals some consistently occurring structural properties; we will 
discuss several of these here at a qualitative level. 
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A range of connectivity relations. A first observation is that the graphs G u are 
not, in general, connected. This is intuitively very natural: the initial root set 
typically induces very few edges; and while the expansion to the base set serves 
to connect many of these nodes, others remain in small isolated components. 

A graph G u of this form, however, does typically contain a “giant component” 

a connected component that contains a significant constant fraction of all the 
nodes. In all the cases considered, there was only a single giant component of 
G u . 

Turning to a stronger measure, we consider biconnectivity : we say that two 
nodes u and v are biconnected if there is no third node w so that w lies on 
all u-v paths. We will call the equivalence classes of nodes under this relation 
the biconnected components. The graph G u typically has a “giant biconnected 
component,” again unique. Thus, we can intuitively picture the structure of G u 
as consisting of a central biconnected “nucleus,” with small pieces connected 
to this nucleus by cut-nodes, and with other small pieces not connected to this 
nucleus at all. 

The biconnected nucleus contains much of the interesting structure in G; 
for example, it generally contains all the top hubs and authorities computed by 
HITS. We will use H to denote the subgraph of G induced on this biconnected 
nucleus; H is thus a directed graph, and we use H u to denote its undirected 
version. 

We can try to further refine the structure of H by looking at strongly con- 
nected components. In this we make crucial use of the orientation of edges: u and 
v are related under strong connectivity if each can reach the other by a directed 
path. For this relation, however, we discover the following: the subgraphs H do 
not contain “giant strongly connected components.” Indeed, for many of the 
graphs we considered, the largest strongly connected component had size less 
than 20. 

Thus, while G is not connected when viewed in its entirety, it can be viewed as 
having a large subgraph that is biconnected as an undirected graph. G, however, 
does not generally contain any large strongly connected subgraphs. 

Alternating connectivity. Biconnectivity yielded a giant component; strong con- 
nectivity pulverized the graph into tiny components. It is natural to ask whether 
there is a natural connectivity measure that takes some account of the orienta- 
tion of edges and still results in large “components.” We now describe one such 
measure, alternating connectivity , and observe a sense in which it is difficult to 
find the right definition of “component” under this measure. 

If u and v are nodes, we say that a sequence P of edges in G is an alternating 
path from u to v if (1) P is a path in G u with endpoints u and i>, and (2) 
the orientations of the edges of P strictly alternate in G. Thus, P leads from 
u to v via a sequence of link traversals that alternate forward and backward 
directions. This definition corresponds closely to the HITS algorithm. Intuitively, 
the strict alternation of edge orientations parallels the way in which hub and 
authority weight flows between nodes; and indeed, the hub and authority weights 
effectively compute the relative growth rates of alternating paths from each node. 
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Furthermore, two steps in an alternating path connect two nodes that either cite 
the same page, or are cited by the same page — this notion of co-citation has 
been used as a similarity measure among documents mi and among web pages 



111 mi m 



Suppose we write u ~ v if there is an alternating path between u and v. It is 
clear immediately from the definition that the relation ~ is symmetric; however, 
it is easy to construct examples with nodes u, v, w so that u ~ v and v ~ w, but 
u 7 ^ w. As a result, ~ is not transitive and hence not an equivalence relation. 

However, we can show a sense in which ~ is “nearly” an equivalence relation: 
we can prove that if a node u is related to three nodes then at least 

one pair among {v\,V 2 ,V 3 } is also related. We can call such a relation claw-free 
— no node is related to three nodes that are themselves mutually unrelated. 

In tests on the subgraphs H , we find that a large fraction of all pairs of 
nodes u,v £ H are related by alternating connectivity. Among pairs that are 
related, we can define their undirected distance as the length of the shortest u- 
v path in H u : and we can define their alternating distance as the length of the 
shortest alternating u-v path in H. We find that the average alternating distance 
between related pairs is generally at most a factor of two more than the average 
undirected distance between them; this indicates that the biconnected nuclei H 
are rich in short, alternating paths. 



4 Model 

In this section we lay the foundation for a class of plausible random graph 
models in which we can hope to establish many of our observations about the 
local structure of the Web graph. There are a number of reasons for developing 
such a model: 

1. It allows us to model various structural properties of the Web graph — node 
degrees, neighborhood structures, etc. Of particular interest to us is the 
distribution of Web structures such as CVy’s which are signatures of Web 
communities or other Web phenomena of interest. 

2. It allows us to predict the behavior of algorithms on the Web; this is is of 
particular interest when these algorithms are doomed to perform poorly on 
worst-case graphs. 

3. It suggests structural properties of today’s Web that we might be able to 
verify and then exploit. 

4. It allows us to make predictions about the shape of the Web graph in the 
future. 

Desiderata for a Web graph model. We begin by reviewing some criteria that 
are desirable in such a graph model; many of these are motivated by empirical 
observations on the structure of the Web graph. Next we present our model. 
Note that we do not seek to model the text or the sizes of the pages; we are 
only interested here in the interconnection patterns of links between pages. We 
would like our model to have the following features: 
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1. It should have a succinct and fairly natural description. 

2. It should be rooted in a plausible macro-level process for the creation of 
content on the Web. We cannot hope to model the detailed behavior of the 
many users creating Web content. Instead, we only desire that the aggregate 
formation of Web structure be captured well by our graph model. Thus, while 
the model is described as a stochastic process for the creation of individual 
pages, we are really only concerned with the aggregate consequences of these 
individual actions. 

3. It should not require some a priori static set of “topics” that are part of the 
model description — the evolution of interesting topics and communities 
should instead be an emergent feature of the model.Q Such a model has 
several advantages: 

— It is extremely difficult to characterize the set of topics on the Web; 
thus it would be useful to draw statistical conclusions without such a 
characterization . 

— The set of topics reflected in Web content has proven to be fairly dy- 
namic. Thus, the shifting landscape of actual topics will need to be ad- 
dressed in any topic-aware model of time-dependent growth. 

4. We would like the model to reflect many of the structural phenomena we 
have observed in the Web graph. 

4.1 A class of random graph models 

In our model, we seek to capture the following intuition: 

— some page creators on today’s Web may link to other sites without regard 
to the topics that are already represented on the Web, but 

— most page creators will be drawn to Web pages covering existing topics of 
interest to them, and will link to pages within some of these existing topics. 

We have already observed that the Web graph has many hub pages that 
contain resource lists focused on a topic. Here is the dominant phenomenon for 
link-creation in our model: a user encounters a resource list for a topic of interest 
to him, and includes many links from this list in his/her page. 

We reiterate that this process is not meant to reflect individual user behavior 
on the Web; rather, it is a local procedure which in aggregate works well in 
describing page creation on the Web and which implicitly captures topic creation 
as follows: first, a few scattered pages begin to appear about the topic. Then, 
as users interested in the topic reach critical mass, they begin linking these 
scattered pages together, and other interested users are able to discover and 
link to the topic more easily. This creates a “locally dense” subgraph around 
the topic of interest. This intuitive view summarizes the process from a page- 
creator’s standpoint; we now recast this formulation in terms of a random graph 
model that — again, on aggregate — captures the above intuition. 

1 In particular, we avoid models of the form “Assume each node is some combination 
of topics, and add an edge from one page to another with probability dependent on 
some function of their respective combinations.” 
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Indeed, it is our thesis that random copying is a simple, plausible stochastic 
mechanism for creating Ziphan degree distributions. Below, we state at a high 
level our model for the evolution of the Web graph. We are unable to provide 
complete probabilistic analyses of the graphs generated by even the simplest 
concrete instantiations of such models. Heuristic calculations, however, yield 
distributions for degree sequences, Cij’s and other local structures that conform 
remarkably well with our observations. 

Our model is characterized by four stochastic processes — creation processes 
C v and C e for node- and edge-creation, and deletion processes V v and V e for node- 
and edge-deletion. These processes are discrete-time processes. Each process is 
a function of the time step, and of the current graph. 

A simple node-creation process would be the following: independently at each 
step, create a node with probability a c (t). We could have a similar Bernoulli 
model with probability ad(t) for node deletion; upon deleting a node, we also 
delete all its incident edges. Clearly we could tailor these probabilities to reflect 
the growth rates of the Web, the half-life of pages, etc. 

The edge processes are rather more interesting. We begin with the edge- 
creation process C e . At each step we sample a probability distribution to deter- 
mine a node v to add edges out of, and a number of edges k that will be added. 
With probability f3 we add k edges from v to nodes chosen independently and 
uniformly at random. With probability 1 — (3, we copy k edges from a randomly 
chosen node to v. By this we mean that we choose a node u at random, and 
create edges from v to nodes w such that (u, w) is an edge. One might reasonably 
expect that much of the time, u will not have out-degree exactly k; if the out- 
degree of u exceeds k we pick a random subset of size k. If on the other hand the 
out-degree of u is less than k we first copy the edges out of u, then pick another 
random node v! to copy from, and so on until we have enough edges. Such a 
copying process is not unnatural, and consistent with the qualitative intuition 
at the beginning of this section. 

A simple edge-deletion process T> e would again be a Bernoulli process in 
which at each step, with probability 6, we delete a randomly chosen node. The 
probability that a particular node v is deleted would ideally be non-increasing 
in its in-degree. 

We illustrate these ideas with a very simple special case. Consider a model 
in which a node is created at every step. Nodes and edges are never deleted, 
so the graph keeps on growing. Consider the following edge process: for some 
(3 £ (0, 1), at each step the newly-created node points to a node chosen uniformly 
at random. With probability 1 — (3, it copies a uniform random edge out of a 
random node. Simulations (and heuristic calculations) suggest that under this 
model, the probability that a node has in-degree i converges to i . Similar 
calculations suggest that the numbers of cores Cij are significantly larger than 
random graphs in which edges go to uniform, independent random destinations. 

Clearly the processes creating these graphs, as well as the statistics and 
structures observed, differ significantly from those of traditional random graph 
models. This is both a feature and a challenge. On the one hand, the relationship 
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between copying and Zipfian distributions is of intrinsic interest for a variety of 
reasons (given such distributions also arise in a number of settings outside of 
the Web — in term frequencies, in the genome, etc.). On the other hand, the 
process of copying also generates a myriad of dependencies between the random 
variables of interest, so that the study of such graphs calls for a whole new suite 
of analytical tools. 

5 Conclusion 

Our work raises a number of areas for further work: 

1. How can we annotate and organize the communities discovered by the trawl- 
ing process of Section 

2. What extensions and applications can be found for the connectivity measures 
discussed in Section ECU '* 

3. What are the properties and evolution of random graphs generated by spe- 
cific versions of our models in Section EP This would be the analogue of the 
study of traditional random graph models such as S n ,p- 

4. How do we devise and analyze algorithms that are efficient on such graphs? 
Again, this study has an analogue with traditional random graph models. 

5. What can we infer about the distributed sociological process of creating 
content on the Web? 

We thank Byron Dom and Ron Fagin for their comments. The work of Jon 
Kleinberg was supported in part by an Alfred P. Sloan Research Fellowship and 
by NSF Faculty Early Career Development Award CCR-9701399. 
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Abstract. We investigate the space complexity of the (undirected) graph 
accessibility problem (UGAP for short). We first observe that for a 
given graph G, the problem can be solved deterministically in space 
0(sw(G) 2 log 2 n), where n denotes the number of nodes and sw(G) de- 
notes the separation- width of G that is an invariant of graphs introduced 
in this paper. We next observe that for the class of all graphs consisting 
of only two paths, the problem still remains to be hard for determin- 
istic log-space under the NC 1 -reducibility. This result tells us that the 
problem is essentially hard for deterministic log-space. 



1 Introduction 

It is widely know that the (undirected/directed) graph accessibility problem 
(UGAP / GAP for short; this is alternatively called the st-connectivity prob- 
lem)) captures the nature of space-bounded (symetric/nondeterministic) compu- 
tations. Because of this, its computational complexity has been investigated for a 
long period since 1970’s. It was shown by Savitch jSav7fl| that GAP can be solved 
deterministically in space 0(log 2 ro). However, no improvement on the amount 
of space has been accomplished so far. At this point, many researchers have con- 
jectured that 0( log 2 n) space would be required to solve the problem. On the 
other hand, there have been several remarkable results on UGAP. Alleliunas et. 
al. [AKL79I showed that UGAP can be solved probabilistically in logarithmic 
space and simultenousely in polynomial average time. Furthermore Nisan INisH2l 
showed that UGAP can be solved deterministically in space 0( log 3 / 2 n) and Ar- 
moni et. al. lATWUI recently improved this space bound to 0( log 4 / 3 n). 

In this paper, we investigate the space complexity of UGAP. The aim of our 
investigation is to relate some invariant on graphs to the space complexity of 
UGAP. We first show that for a given graph G, the problem can be solved deter- 
ministically in space 0(sw(G) 2 log 2 n ), where n denotes the number of nodes and 
sw(G) denotes the separation- width of G that is an invariant of graphs intro- 
duced in this paper. As an immediate consequence, for the class of all graphs with 
separation-width bounded above by a given constant, the problem can be solved 
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deterministically in logarithmic space. We also observe that the separation- width 
is smaller than or equal to the path-width. Thus, we also obtain the same result 
for the class of graphs with bounded path-width. As far as the authors know, 
there was no nontrivial class of graphs, except the class of cycle-free graphs, for 
which the problem is solvable deterministically in logarithmic space. Thus, our 
result observe a second nontrivial class of graphs with that property. We next 
show that for the class of all graphs consisting of only two paths, the problem still 
remains to be hard for deterministic log-space under the NC-reducibility. This 
result observes that the problem is essentially hard for deterministic log-space. 

2 Preliminaries. 

For any graph G = ( V , E ) and any subsets X , Y of V, we simply say that there 
exists a path between X and Y on G if there is a path on G that connects some 
node in X with some node in Y . We alternatively say that X is connected to 
Y on G or say that Y is reachable from X on G. In this paper, we will use 
the terminology “incident” with an unusual meaning, defined as follows. For any 
subsets X, Y of V, we say that X is incident with Y if either X n Y ^ 0 or 
there is an edge connecting a node in X with a node in Y . We will further define 
Ng{u) of a node u to be the set {v € V : uv £ E}U{u}. Furthermore, we denote 
by Nq(X), for a subset X of V, the set LL-gx Ng(x). For a subset X of V, we 
define Eq[X\ = {uv £ E : u £ X or v £ X }, and for a subset F of E, we define 
Vg[E] = {u £ V : 3v £ V[uv ef]}. 

We below define some invariant of graphs that is relevant to the present 
paper. 

Definition 1. We define a layout of G to be a bijection from V to the set 
{1, 2, • • • , |P|}. We also call each element of the set {1, • • • , |P|} a location when 
dealing with any layout of G. Let ip be a layout of G. We say that an edge uv £ E 
crosses a location i (w.r.t. p) if either p(u) < i < p(v) or <p(v) < i < p(u). 
We denote by E^i) the set of all edges crossing a location i. Furthermore, we 
say that a path on G crosses a location if the path contains an edge that crosses 
the location. 

For a location i, we define V~(i), V+(i), and V*{i) as follows: 

Vff{i) = {u£ V G [E v (i )] : <p(u) < i}, 

V+(i) = {v £ Vg[E v {i)\ : i < cp(v)}, 

V*(i\ = l V *^ WOI 

v ' ' \ V+ (i) otherwise 

Then we define the separation-width of G with respect to <p, denoted bysw v (G), 
by 

sw V (G) = max{|V£(i)| : 1 < i < |V|}. 

We further define the separation-width sw (G) of G by sw(G) = min^sw ip{G), 
where the minimum is taken over all possible layouts of G. 
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It was shown in that for each graph, its vertex separation numbers is 

equal to its path- width (though we omit the definitions of those invariant), and 
it is easy to verify that for each graph, its separation-width is smaller than or 
equal to its vertex separation number. Though we don’t use these facts in this 
extended abstract, this may give the reader a brief intuition on the separation- 
width since the path-width is much common in graph theory community. 

Hereafter, we only deal with the separation- width. Thus, we say that a layout 
(p of G is optimal if sw P (G) = sw(G). 

For a set A and a nonnegative integer k, we define 2 A,k to be the set of all 
subsets whose number of elements is at most k. For a set E, we denote by E* 
the set of all finite sequences of elements in E. We further denote a sequence 
in E* consisting of elements ai, 02 , • • • , a m by (ai, 02 , • • • , a m ) or by (aj)JL 1 . We 
sometimes abbreviate the range of the indices from the latter notation when it 
is clear in the context. 

3 An algorithm 

In this section, we show that UGAP can be solved deterministically in space 
0(sw(G) 2 log 2 n) for a given graph G, where n denotes the number of nodes in G. 

Definition 2. For all nonnegative integers k, we define two predicates denoted 
REACH k and SIDE k respectively, and we define a function denoted NEXT k , as 
described in Figure 1. For any nodes x,y in a graph G, we abbreviate REACH k (G, 
{x},{y}), NEXT k (G,{x},{y}), and SIDE k (G,{x}) by REACH k (G,x,y), NEXT k 
(G,x,y), and SIDE k (G,x ) respectively. 



Let A: be a nonnegative integer, let G = {V,E) be a graph, and let 
S, T be any subsets of V. Then, we define a predicate REACH* (G, S, T) 
inductively as follows. 

(I) REACH 0 (G,5,T) <s> 5nT^0. 

(II) For all k > 1: REACH*, (G, S, T) 

t 

Either REACH fc _!(G, S, T) holds, or there are a node u £ V and 
a sequence of sets Xq,X\, . . ., X m £ 2 v,k satisfying the conditions 
(Rl) through (R4) below, where we define X_i = X m+1 = 0. 

(Rl) X 0 = {«}. 

(R2) For all p{ 0 <p<m), NEXT fc (G, X, p _ } ,X p ) = X p+1 . 

(R3) For some p(0 < p < m), 

REACH*_i(G - E[X P _! UX p U X p+1 ],S, N G (X p )). 

(R4) For some g(0 < q < to), 

REACH fc _!(G - E[X q _i Ul,U X q+1 \,N G (X q ),T). 



Fig. 1(a). The definition of REACH* . 
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In order to define NEXT*,, we suppose an arbitrary linear ordering over 
2 V ’ k such that for all graphs G = (V,E) and two subsets X,Y £ 2 V ' k , 
we can test deterministically in space 0( log 2 |V|) whether X is less than 
Y under the linear ordering. 

Now let G = (V, E) be a graph and let X , Y be any subsets of V. 
Then, we define NEXT*,(G, X, Y), where k > 1, to be the minimum set 
under the ordering among all sets Z £ 2 v,k satisfying the conditions (Nl) 
through (N3) described below. 

(Nl) For all z £ Z, ^SIDE fc (G - E[X U Y],z). 

(N2) For all w £ N G (Y), SIDE fe (G - E[X U Y U Z],w). 

(N3) For all z£Z, REACH fc _i(G - E[X UFU Z],N G (Y),N G (z)). 

If there is no set in 2 v,k satisfying the above conditions, then we conven- 
tionally define NEXT k (G,X,Y) = 1. 



Fig. 1(b). The definition of NEXT*,. 



For all graphs G and all nodes w of G: 

SIDE*,(G, w) i k > lj 

t 

(51) For all v £ V, REACH fc _i(G, w, N G (v)) => REACH fc _i(G, w, v), 
and 

(52) For all u, v £ V, REACHfc_i(G, w, u) and 

REACH fe _ 1 (G, w, v) =>• REACHfc_i(G, u, v). 



Fig. 1(c). The definition of SIDEfc. 

It is not difficult to see that the predicates and the function defined above 
can be realized by (recursive) algorithms that operate in space 0(k 2 log 2 n). Our 
purpose of this section is to prove that for all graphs G with sw(G) < k and all 
subsets S, T of the node set of G, REACH*, (G, S, T) holds if and only if there 
exists a path on G between S and T. That is, we will prove the following theorem 
throughout the whole of this section. Note that the statement (a) and (b) below 
are the core claims of the theorem and the other statements are technically used 
to prove the core claims. 
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Theorem 1. Let k be any nonnegative integer , let G = (V,E) be any graph, 
and let S,T be any subset ofV. Then we have the following. 

(a) If REACH k {G, S,T) holds, then there is a path on G between S and T. 

(b) Conversely, if sw(G) < k and there is a path on G between S and T, then 
REACH k (G,S,T ) holds. 

(c) Let s and t be any nodes in G and let H be any subgraph of G. We also sup- 
pose that H contains both the component of G including s and the component 
ofG including t. Then, REACTING, s,t) holds if and only if REACH k (H, s,t) 
holds. 

(d) Let s and t be any nodes in G and let S and T be any subsets of V. We 
also suppose that S contains s and T contains t. Then, if REACH k (G, s,t) 
holds, then REACH k (G, S,T) holds. 

We prove this theorem by using an induction on k. It is obvious that the 
theorem holds for k = 0. Now, let k be any positive integer and let us assume, 
as an induction hypothesis, that the statements (a) through (d) in the above 
theorem hold for all nonnegative integers less than k. Note that we will use this 
induction hypothesis until the end of the present section. Since the proof for the 
induction step is involved, we conventionally denote the induction hypothesis by 
Th[fc - 1], 

The most difficult part of the induction step is to prove the statement (b) in 
the theorem. Proving the other statements are easy and are omitted. Hereafter 
until almost end of this section, we prove Theorem □Kb). To begin it, we first 
observe some elementary properties of SIDE*, that will be used frequently. 

Lemma 1. Let G = (V,E) be a graph, let w be a node in G, let C w denote a 
component of G that contains w, and let V w denote the node set of C w . Then 
we have the following. 

(a) SIDE k {G,w) holds if and only if for all nodes u,v £ V w , REACHk-i{G,u,v) 
holds. 

(b) SIDE k (G,w) holds if and only if for all nodes u £ V w , SIDE k (G,u). 

(c) If sw(C w ) < k, then SIDE k (G,w) holds. 

Before going into the proof of Theorem [D^b) , we here give a brief explanation 
on the role and/or the motivation of the predicate SIDE*,, based on the lemma 
above. We further give a brief explanation on the role of the function NEXT*,. 
These may be helpful for the reader to understand how our algorithm works 
well. 

For a given node w in a graph G, SIDE fc (G, w) has a role to check whether, 
for all pairs of nodes in the component containing w, REACHfc_i can correctly 
verify the existence of a path between the two nodes. This role can be seen from 
(a) of the last lemma. Note also, from the contrapositive of Th[fc — 1] (a), that 
for all pairs u, v of nodes in G, if there is no path between the two nodes, then 
REACHf._i(G, it, v) never holds. Therefore, in a happy case that SIDEfc(G, w) 
holds for all nodes w in G, we may use REACHfc_i recursively to check the 
existence of a path between any pair of nodes in G. From (c) of the last lemma, 
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we know that this case happens when sw(G) < k. However, in a bad case that 
sw(G) > k, REACHfc_i might not work well; that is, there might be some node 
w for which SIDE*, (G, w) did not hold and hence there might be two nodes u,v 
for which REACHfc.^G, u, v) did not hold while there was a path between the 
two nodes. In this bad case, we know that there is a component of G such that 
for all nodes w in the component, SIDEfc(G, w ) does not hold. Hereafter, we call 
such a component fat and in contrast, we call a component slim if for some 
node w in the component, SIDEfc(G, w) holds. 

On a fat component, we must give a help to REACHfe_i in order to let it work 
well. Roughly speaking, our algorithm helps it as follows. For a fat component 
G of G, our algorithm finds a sequence Xo, Xi, ■ ■ ■ , X m C Vc, where Vc denotes 
the node set of G, such that by deleting all edges incident with UjLo fr° m 
G, we can make G slim; more precisely speaking, by deleting all of the edges, we 
can divide C into several components that are all slim. Then, after the deletion, 
our algorithm uses REACHfc_i to check the accessibility between all pairs of 
nodes in G. 

What our algorithm does is slightly different from one mentioned in the 
above paragraph because of the amount of space available. Since it must work 
within a small amount of space, it computes the sequence of subsets as above 
sequentially and gradually one after another for j = 0,1,..., to rather than 
finding all of them for once. Furthermore, it keeps only three subsets at a same 
time. This is a motivation behind NEXT&. 

Now let us return to proving the induction step of Theorem EKb). The fol- 
lowing definition is a convention for making our presentation concise. 

Definition 3. Let G = (V, E) be a graph. For all subsets X , Y of V, we denote 
by path(G, X, Y) a predicate that is true if and only if there is a path on G 
between X and Y . 

The following definition formalizes a notion of sequences like one mentioned 
above, which is suitable for our purpose. 

Definition 4. Let G = (V, E) be a graph and let (Xj)JL 0 be a sequence in 
(2 V )*. Then, we say that the sequence is k-fat tissue if and only if it satisfies 
the following conditions: 

(0) \Xj\ < k for all j( 0 < j < m) and there is an optimal layout tp of G such 
that Xq = {</? -1 (l)}. 

(1) For all p ( 0 < p < to) and all w € Ng{X p ), SIDEkiG — -ElUjlo Xj],w) 
holds. 

(2) For allp(0<p<m) and ally € X p+ i, path(G— X[U”1 0 X^], Nq(X p ), Ng{v)) 
holds. 

(3) For all p(0 < p < m), path(G — E[X P \, Uj=o Xj, Ujlp+i Xj) does not hold. 

We call each Xj a cell of the k-fat tissue, and for any p,q with 0 < p, q < m, 
we call E[[J^ =p Xj] a k-fat of the k-fat tissue. 
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We below give a brief explanation about the intention behind each condition 
in the above definition, for the sake of an intuitive understanding on how our 
algorithm works well. 

The condition in (0) above that each cell is of size at most fc is intended 
to ensure that they are not so large compared with the parameter k. The other 
condition X$ = {<^ -1 (l)} in (0) together with the condition (2) above guarantees 
that a single component of G contains all cells. 

The condition (1) above guarantees that by deleting all edges incident with 
the k- fat tissue, we can divide the component containing the tissue into several 
slim components. We note here that each of the slim components obtained after 
the deletion must be incident with some cell, and hence we also note that the 
node w mentioned in (1) above are intended as a “representative” for one of the 
slim components. 

The condition (3) together with the condition (2) is intended to ensure that 
each cell in the fc-fat tissue can be computed sequentially and “locally” in the 
sense that each X p+ i can be found only by using X p _i and X p . To understand 
this intention more, let us consider a situation that we could find a part of the 
fc-fat tissue, say Xq. Xi, • • • , X p for some p < m, and that we wanted to find out 
a next cell X p+ \. If SIDEfc(G, w) holds for all nodes w £ Uj=o Xj, then we need 
nothing to do; that is, we may set X p+ i to the empty set. Otherwise, by the 
condition (2), we must seek X p+ i among the nodes reachable in G — E[ Uj =0 A?] 
from Ng{X p ). However, we meet a difficulty here in that task. It is that we have 
no space to keep all Xj’s found so far. On the other hand, we are allowed in 
that task to deal with G — E[X p _ i U X p ] instead of G — Jv [Uy=o Xj\- This is 

because the condition (3) ensures that all nodes in G reachable from Uj=o ^0 
not reachable from any nodes in X p without passing through X p _\. This is the 
intention behind the condition (3). We also note that this consideration leads us 
to the definition of NEXT . 

Hereafter for a while, we will discuss about the existence of a fc-fat tissue for 
all components of G with separation-width at most fc. 

Definition 5. Let G = ( V , E ) be a graph and let (Xj)JL 0 be a sequence in (2^)*. 
Then, we say that (Xj) is a k-fat substance of G if and only if it satisfies the 
conditions (0), (2), and (3) of being a k-fat tissue and satisfies the following 
condition (1' ) instead of (1): 

(1') Forallp(Q < p < m) and all nodes w £ Ng(X p ), SIDEk(G—E[{J™_ 0 Xj\, w ) 
holds. 

Only the difference from the condition (1) of being a fc-fat tissue is that the last 
set X m in the sequence may not satisfy the conditions on SIDE^. Note that any 
fc-fat tissue is also a fc-fat substance. 

We can show that a sequence is fc-fat substance if and only if it is a prefix of a 
fc-fat tissue. However, this is not trivial. We will observe this fact in Theorem Q 

As mentioned previously, any fc-fat tissue is in a single component. More 
generally, we can observe the following lemma. We will use this fact everywhere 
without specifying explicitly (since this is almost obvious). 
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Lemma 2. Let G = {V, E) be a graph and let (Xj)JL 0 be a k-fat substance of G. 
Then, there exists a single component of G that contains all nodes in Uj=o Xj ■ 

The next proposition tells us the existence of a fc-fat substance for all con- 
nected graphs. 

Proposition 1. Let C be a connected graph and let ip be an optimal layout of 

C. Then, the sequence ({y> _1 (l)}) is a k-fat substance of C . 

The next lemma says that for all fc-fat substances (Xj) p _ 0 of a connected 
graph C, if there exists a fat sub-component after deleting all edges incident 
with U j~o Xj , then the fat sub-component must be incident only with X p but 
not incident with other Xj’s. 

Lemma 3. Let C = (V, E) be a connected graph and let {Xj) p =0 be a k-fat sub- 
stance ofC. Then we have that for all nodes w £ V, if SIDE^iC — E[[J P =0 Xj], w) 
does not hold , then there is no path on C—E[X p ] between Uj=o Xj and V w , where 
V u , denotes the node set of the component of C — E[\J P _ 0 Xj] which contains ut. 

Now we show that each fc-fat substance can be extended to some longer fc-fat 
substance and that each fc-fat substance is a prefix of a fc-fat tissue. 

Theorem 2. Let C = (V,E) be a graph and suppose sw (C) < fc. Furthermore, 
let a = (Xj) p = 0 £ (2 V ’ k )* be a k-fat substance ofC. Then, we have the following: 

(I) There is a set X p+ \ £ 2 v,k satisfying the following conditions. 

(i) For all nodes z £ X p+ i, ~^SIDEk(C — -E[Uj=o Xj\, z). 

(ii) For all nodes w £ Nc(X p ), SIDEk(C — E[{J P _ 0 Xj U X p+ f\,vS). 

(Hi) For all nodes z £ X p+ \, pdX\i(C—E\fJ p -_ 0 XjVJX p+ i],Nc{X p ),Nc{z)). 

(II) For all sets X p+1 £ 2 v,k satisfying the conditions (i) through (Hi) above, 
(3 = (Xo, ■ ■ ■ , X p , X p+ i) is a k-fat substance of C. 

(III) Suppose X p+ i = 0 satisfies the conditions (i) through (Hi) above. Then, 
only the empty set satisfies the conditions and a is a k-fat tissue of C . 

Proof. We give an outline of the proof of (I) and omit the proofs of (II) and 
(III). 

In the case in which SIDE^C — -E7[Uy =0 Xj], w) holds for all nodes w £ V, 
we can easily verify that X p+ i = 0 satisfies all of the conditions (i) through (iii) 
above. Thus, until the end of this proof, we consider the case that SIDE^C — 
E\£) p =0 Xj\,w) does not hold for some node w £ V. Note that in this case, 
sw(C) = fc. This can be seen from Lemma EJc) (together with the monotonic 
property of the separation-width with respect to the subgraph relationship). 

Let p be an optimal layout of C and let D = (Vd,Ed) denote a fat com- 
ponent of C — E[{j p _ 0 Xj]. Note here that sw (D) = k and for all nodes w in 

D, SIDEfc(C — E[Uj = o Xj]. w) does not hold. We will use this fact frequently. 
Below, we observe several facts required for the current proof. 
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We can see that D has no node common with 1J^ =0 Xj, as follows. Assume, 
to a contrary, that D has a common node with U j=o Xj • Then D must consist 
of a single node because before defining D , we have deleted all edges incident 
with \J p J=0 Xj. Thus we see sw (D) = 0. However, this is impossible because 
sw (D) = k > 0. 

To show another fact, we define hx by hx = max {<, p(x ) : x £ Uj=o Xj}, and 
we define ho to be any location i satisfying V* (i) C Vo and \V*(i)\ = k. The 
existence of such a location is guaranteed by the fact sw(D) = k. We further 
note that all edges crossing the location ho belong to Ed- Now we can show the 
following fact. 

Fact A hx < ho- 

Proof. Let X q , for some q(0 < q < p), contain a node whose location is hx and 
let u q denote the node. Then, it follows from the conditions (2) and (3) of (Xj) 
being a Pfat substance that there exists a path P = uq, Pi, u\, P 2 , • ■ • , u q -\,P q , u q , 
where uq = <^ _1 (1) and for each i > 1, m belongs to Xi and each Pi is a path 
on C — E[[j ^ 0 Xj] between Nc(ui-i) and Nc(ui). Since each Pi is a path on a 
component of C — E[[J^_ 0 Xj] that is incident (on C) with A,-!, we see, from 
the condition (1') of (Xj) being a fc-fat substance together with Lemma [QB), 
that for all nodes v on Pj, SIDEfc(C — P[(Jj=o Xj], w) holds. By this fact together 
with the fact on D mentioned previously, we see that P has no common node 
with D. This implies that any path crossing ho cannot cross all location i with 
1 < i < hx since P crosses all of those locations. Thus we have hx < ho- 

(End of FACT A) 

We next observe that there is at most one fat component in C — E[[ Jj =0 Xj]. 
Fact B There is at most one fat component in C — P[Uj=o^]- 
Proof. Assume, to a contrary, that there are two fat components, say D\ = 
(V\,Ei) and D 2 = (V2, P2). in C — E[\J^ =0 Xj]. For t = 1,2, let h t denote a 
location i satisfying V*(i) C Vo and V* (i) = k. The existence of such a location 
is guaranteed by the fact sw (D t ) = k. We further assume h\ < h 2 without loss 
of generality. From the Fact A, we have hx < h\ <h 2 . Now consider a path on 
C between y> _1 (l) and a node in D 2 with location greater than or equal to h 2 . 
Then the path must cross the location h\. This means that the path must pass 
through inside of D\. Furthermore, when walking along the path starting from 
(p 1 (1) until the node in D 2 , we never meet any nodes in 1J^ =0 Xj after the last 
point where we cross the location h\. This implies that D 2 are connected with 
D 1 in C — E[[j^ 0 Xj]. However, this contradicts that D 1 and D 2 are different 
components in C — E[[ J^ =0 A ? ] . (End of FACT B) 

Let us denote again by D = ( Vo,Eo ) a unique fat component ofC — 
P[Uj_o Xj], Furthermore, we define go to be the minimum among all loca- 
tions i satisfying V*(i) C Vo and |V^(i)| = k. We then define A p+i as follows: 
Xp+\ = {z£ V;(g D ) : P ath(C - P[U^ 0 Xj U V;(g D )\, N C (X P ), N c (z)}. 

We here note that |A p+ i| < k since \V*(go)\ < k. We below show that this 
A p+ i satisfies the conditions (i) through (iii). 

Since all nodes in A p+1 are in Vo and D is a fat component of C—E[\ Jj =0 Xj], 
we have that for all nodes z £ A p+1 , SIDEfc(C — P[lJj = o Xj], z) does not hold. 
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Thus we have the condition (i). Since C — X ? U V* (gn)\ is a subgraph 

of C — E[[j p =0 UX p+ -[], we see from the definition of X p+ \ that for all nodes 
2 £ X p+ i, there is a path on C — E{ (J? =0 UA' p+ i] between Nc(X p ) and Nc{z). 
Thus we have the condition (iii). 

To see the condition (ii) holds, let gx = max {ip(x) : x £ X p }, let w be a node 
in Nc(X p ), and let D w be a component of C — -E[Uj=o UA p+ i] that contains 
the node w. If D w does not contain any nodes in D , then we see that D w is also 
a component of C — -E[Uj=o Xj}- Hence, we see, from Fact B that D is the only 
fat component of C — E[[Jj_ 0 Xj], that D w is not a fat component and hence 
SIDE*(C — -B[Uj=o Xj U X p+ i],w) holds. We below assume that D w contains a 
node in D. We note that in this case, D w is a subgraph of D. 

Now consider two cases. The first case is when D w contains a node in X p U 
X p+ \. Then by its definition, D w consists of a single node and hence sw (D w ) = 
0 < fc. This together with Lemma ID c) implies that SIDE*(C — E[\J p =(j Xj U 
X p _|_i],'w;) holds. 

Now consider the second case that D w does not contain a node in J p UX p+1 . 
In this case, all edges connecting X p and D w cannot cross the location g *>. For, 
assuming that such an edge cross go, one end-point of the edge must belong 
to A'p+i and also to D w but this is a contradiction. We also see that D w never 
contains an edge crossing the location gn, by its definition. Thus, we have that 
either for all nodes y in D w , ip(y) < go , or for all nodes y in D w , ip(y) > gr>- On 
the other hand, since gx < <?d by Fact A and there must be the edge connecting 
X p with w, we see that tp(w) < gr>- Thus, we can observe that for all nodes 
y in D w , ip(y) < go- This together with the minimality of gr> implies that 
sw (D w ) < k (recall D w is a subgraph of D in our current case). Thus, we have 
that SIDE fe (C' - £[Uj= 0 Xj U X p+1 ], w) holds. 

By the discussion above, we have the condition (ii) too. 

Proposition |T| and Theorem |2| tell us how to compute a £;-fat tissue of a given 
connected graph C , when we could find the top node of an optimal layout of 
C. On the other hand, we don’t need find the top node. Instead, we may enu- 
merate all nodes in C and may check whether we could extend each node to a 
fc-fat tissue. REACH*,, NEXT*,, and SIDE*, is defined along this line. Particu- 
larly, NEXT* realizes the function to extend a fc-fat substance to a longer one. 
We want the reader to note the similarity between the conditions mentioned in 
Theorem |21(I) and those used in NEXT*. However, there is still a gap between 
them. In Theorem □;i), the conditions are global in a sense that they are de- 
pendent on the whole sets of a fc-fat substance under consideration, while the 
conditions (Nl) through (N3) used in NEXT* are local in a sense that they are 
dependent only on a few sets in the fc-fat substance. The theorem below fills in 
this gap. 

Theorem 3. Let G = (V, E ) be a graph with sw (G) < fc and let a = ( Xj) p _ Q £ 
(2 v,ky a fc.fai substance of G. Then, we have the following. 

(I) There is a set X p+ i £ 2 v,k with NEXTk(G, A p _i, X p ) = X p+ i; that is, 
NEXTk(G, X p -i, X p ) = _L never holds. 
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(II) For all sets X p+ i £ 2 v,fc such that NEXT k (G, X p _\, X p ) = X p +\, /3 = 
(Xo, • • • , X p , X p+ i) is also a k-fat substance of G. 

(III) If NEXT k (G , X p -i, X p ) = 0, then the set X p+ \ = 0 is the only set that 
satisfies NEXT k {G, X p _i, X p ) = X p+ i. Furthermore, in this case, a is a 
k-fat tissue. 



Corollary 1. Let G = (V. E) be a graph with separation-width at most k, let 
ip be an optimal layout of G, and let a = ( Xj)JL 0 be a sequence in (2 v - k )* . 
Furthermore, a satisfies the following conditions. 

(Rl) X 0 = {^(l)}. 

(R2) For allp ( 0 <p<m), NEXT k (G,X p _ u X p ) = X p+1 . 

Then the sequence a is a k-fat tissue of (a component of) G. Conversely, any 
k-fat tissue a of (a component of) G satisfies the above conditions. 

Now, we are ready to prove the induction step for Theorenfl](b) . 

Proof of Theorem©!)) Assume there exists a path on G between S and T. 
Then, let C = ( V G ,E G ) denote a component of G that contains some node in 
S and some node in T simultaneously. If sw(C) < k, then we have the claim 
immediately from the induction hypothesis. Thus, we below assume sw(C) = 
k. 

Let a = ( Xj)JL 0 be a fc-fat tissue of C. From the assumption that there exists 
a path on C between S and T, there must be some component of C—E[ UJ1 0 Xj] 
that contains some node in S and that is incident with some X p . Similarly, there 
must be some component of C that contains some node in T and that is incident 
with some X q . Let D p and D q denotes the two components respectively. 

Then, from the condition (1) of a being a fc-fat tissue, SIDEfc(C— E^^Z Q Xj],v}} 
holds for all nodes in V p D N G (X p ), where V p denotes the node set of D p . Com- 
bining this with Lemma ID a), we have the following. 

(a) For some p(0 < p < to), REACH ^(C - E[ \J"l 0 Xj],S, N G (X p )). 

By a similar argument, we also have the following. 

(b) For some q(0 < q < to), REACH fe _r(C - E[ U”L 0 N G (X g ), T). 

In below, we modify these conditions into other equivalent ones. 

When D p contains some node in |J”Lo Xj , we easily see that D p consists 
of a single node in X p . Thus, in this case, we see that D p is a component of 
G — E[ (Jjip-r Xj}. On the other hand, when D p does not contain any nodes in 
U™o Xji we see, from the condition (3) of a being a fc-fat tissue, that D p is not 
incident in C — -ElUyLo Xj] with {J^ZqXj and with Uyl p + 2 ^i- Thus, in this 
case, we also have that D p is a component of G — E[ Xj]. From this (with 
Th[fc — l](c)), we have the following claim, which is the same as the condition 
(R3) in the definition of REACHfc(G, S, T). 

(R3) For some p(0 < p < to), REACH fc _ 1 (G' - E[[ Xj], S, N G (X P )). 
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By a similar argument, we also have the following. 

(R4) For some q(0 < q < m), REACH*_i(G - E[ U®±i_i Xj], N G {X q ), T). 

Since a is a fc-fat tissue of G, we have, from Colloraryd that it satisfies the condi- 
tions (Rl) and (R2) in the definition of REACH* (G, S',! 1 ). Thus, REACH*, (G, S',! 1 ) 
holds. ■ 

Corollary 2. Let k be any positive integer, let G be any graph, and let S and T 
be any subsets of the node set of G. Suppose sw(G) < k. Then, REACHkiG , S, T) 
if and only if there exists a path on G between S and T. 

When we compute SIDE*(G, v) for a graph G, each node v of G, and each 
integer k = 1 , 2 ,... one after another, we can see that for some integer k < 
sw(G) + 1, SIDE*(G, v) holds for all nodes v of G. This is guaranteed by 
Lemma Hj(c). Furthermore, at that point, we can correctly decide the reacha- 
bility in G by using REACH*. This is guaranteed by the above corollary. This 
implies the following corollary. 

Corollary 3. UGAP is decidable deterministically in space 0(sw(G) 2 log 2 n), 
where G denotes a given graph and n denotes the number of its nodes. 



4 Hardness of UGAP 

When a given graph is of separation- width at most one, we see that the graph 
consists of several paths. For such a graph, we might hope that UGAP would be 
solvable more efficiently than deterministic log-space, for example, via an NC 1 
circuit. We further might hope that for all graphs with bounded separation- 
width, UGAP could be solved, say, in NC 1 . However, our second result below 
refutes this hope unless deterministic log-space is contained in NC 1 . 

Let V be an arbitrary set of three-tuples ( G,s,t ) where G is any graph and 
s, t are nodes in G. Futhermore, suppose that V satisfies the following condition: 
for each graph G which consists only of two paths and for all nodes s,t in G, 
G has a path between s and t iff (G, s,t) is in V . In other words, the set V 
gives us a correct answer on UGAP if a given graph consists only of two paths 
(but it may give us a wrong answer otherwise). This is a kind of a solution for 
a so-called promise problem. For a general notion of promise problems, refer to 
the paper G2EE1. 

Theorem 4. Every set V as above is hard for deterministic log-space under 
NC 1 reducibility. 

The proof of this facts is based on the fact that UGAP on the cycle- free 
graphs is hard for deterministic log-space under NC 1 reducibility and on a well- 
known Eularian traversal method on such graphs. We omit the detail. 
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Abstract. Given a graph G = ( V. , E ) and a tree T = (V. F) with E PI 
F = 0 such that G + T = (V, F U E) is 2-edge-connected, we consider 
the problem of finding a smallest 2-edge-connected spanning subgraph 
(V, F U E') of G + T containing T. The problem, which is known to 
be NP-hard, admits a 2-approximation algorithm. However, obtaining 
a factor better than 2 for this problem has been one of the main open 
problems in the graph augmentation problem. In this paper, we present 
an 0(y / nm) time ^-approximation algorithm for this problem, where 
n = \V\ and m = \E U F\. 



1 Introduction 

Given a 2-edge-connected undirected multigraph H = (V, E) with n vertices 
and m edges and a spanning subgraph Ho = (V,Eo), we consider the problem 
of finding a smallest 2-edge-connected spanning subgraph Hi = (V,Ei) that 
contains H 0 . Note that the problem can be regarded as a graph augmentation 
problem of finding a smallest subset E' C E — Eq of edges to augment Hq to a 
2-edge-connected graph H\ = (V,Ei = E 0 U E'). The problem is shown to be 
NP-hard |6| even if Eq = 0. In the case of Eq = 0, the problem, which is called 
the minimum 2- edge- connected spanning subgraph problem (2-ECSS), has been 
extensively studied and several approximation algorithms are known B13IT01 . 
The currently best approximation ratio for 2-ECSS is ^ due to Cheriyan et al. 
0. On the other hand, if Ho is connected, Hq can be assumed to be a spanning 
tree of H without loss of generality (since every 2-edge-connected component 
in Ho can be contracted into a single vertex without losing the property of 
the problem). Let us call the problem with a tree H 0 the minimum 2-edge- 
connected subgraph problem containing a spanning tree (2-ECST). In the special 
case of H being a complete graph, 2-ECST is the problem of augmenting a 
tree Ho to a 2-edge-connected graph by adding a minimum number of new 
edges, for which Eswaran and Tarjan Ej presented a linear time algorithm (which 

* This research was partially supported by the Scientific Grant-in- Aid from Ministry of 
Education, Science, Sports and Culture of Japan, and the subsidy from the Inamori 
Foundation. 
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creates no multiple edges). If H is a general graph, we are permitted to add to 
Hq only edges from E — Eq- For general 2-ECST, there is a 2-approximation 
algorithm jfilfll . which relays on the minimum branching algorithm. However, 
as remarked by Khuller p, p.263], one of the main open problems in the graph 
augmentation problem is to obtain a factor better than 2 for 2-ECST. In this 
paper, we present a ^-approximation algorithm for 2-ECST. Our algorithm is 
based on the maximum matching algorithm and a certain decomposition of a 
tree. Its running time is 0(y/nm ), where n = |V| and m = \E\. 

As pointed out in 013 the following augmentation problem can be reduced 
to 2-ECST: given a /c-edge-connected graph H 0 = (V,E 0 ) for an odd integer k 
and an edge set E with E 0 Eo = 0, find a smallest set E' C E to augment Hq 
to a (k + l)-edge-connected graph. It is known that all fc-edge-cuts in H 0 can 
be represented by a tree T(H 0 ) if k is odd g] (see |7| for efficient algorithms 
for constructing such trees). Thus, the problem can be viewed as the 2-ECST 
in which the tree T(H 0 ) (which represents all fc-edge-cuts in H 0 ) is augmented 
to a 2-edge-connected graph by adding a minimum number of edges from E 
(see m for the detail). Therefore, by applying our result, we can obtain a 
^-approximation algorithm for this problem. 

2 Preliminaries 

A singleton set {x} may be simply written as x. For an undirected graph H = 
(V,E) and an edge set E' , we denote by H + E' (resp., H — E') the graph 
obtained from H by adding (resp., removing) edges in E' . For a subset A^ C V, 
let X denote V — X, and H[ X\ denote the subgraph induced from H by A. 

Let G = (V, E) be an undirected graph, and T = (V, F ) a tree on the same 
vertex set V, where E (~l F = 0 is assumed, but there possibly exits a pair of 
edges e £ E and e! £ F such that e and e! have the same end vertices. We denote 
by E(u) the set of edges in E which are incident to a vertex u £ V. For two 
vertices it, v £ V, let Pt(u,v) denote the path connecting it and v in T. We say 
that an edge e = (it, v) £ E covers an edge e' £ F if Pr(u,v) contains e', and 
that an edge set E' C E covers an edge set F' C F if each edge in F' is covered 
by an edge in E' . Clearly, T + E' is 2-edge-connected for a subset E' C E if and 
only if E' covers F. 

We choose an arbitrary vertex r £ V as a root of T, which defines a parent- 
child relation among vertices in V on T. For a vertex u £ V, let Ch(u) denote 
the set of children of u, and D(u) denote the set of all descendents of it (including 
it). The subgraph T[D(u)) induced from T by D(u) is called the subtree at it 
(which is connected). A vertex u is called a leaf vertex if it has no child, and 
is called a fringe vertex if all the children of it are leaf vertices. For a vertex 
it £ V, let LEAF{u ) (resp., FRINGE(v)) denote the set of all leaf vertices 
(resp., fringe vertices) in the subtree T[D(u)\. In a rooted tree T, we denote an 
edge e £ F with end vertices it and v by an ordered pair (it, v) so that it £ Ch{v) 
holds. An edge e = (it, v) £ F in T is called an leaf edge (resp., fringe edge) of 
it if it is a leaf vertex (resp., a fringe vertex). The subtree T[D{u)] at a vertex 
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u is called a leaf tree if u is a fringe vertex. We call a leaf tree with exactly two 
leaf vertices prime. For an edge e = (u, v ) £ E, we denote by lca(e) the least 
common ancestor of end vertices u and v in the rooted tree T. 

3 Lower bounds 

In this section, we introduce some lower bounds on the number of edges required 
to cover all leaf (and fringe) edges in a subtree in T. 

Lemma 1. Let G = (V,E) and T = (V,F) be a graph and a tree with E fl 
F — 0, respectively, and v be a non-leaf vertex v in T. Then we need at least 
\LEAF(v)\ — \M*\ edges in E to cover all leaf edges in the subtree T[D(y)\, where 
M* C E is a maximum matching in the induced graph G[LEAF(v)\ . 

Proof: Let E' C E be an arbitrary subset that covers all leaf edges in T[D(v)\, 
and let Ei ea f be the set of all edges e = (u,u') £ E with u,u' £ LEAF(v). We 
choose a maximal matching M C E' in the graph (LEAF(v), E’ fl Ei ea f). For 
each unmatched vertex w £ LEAF(v), there must be an edge e w £ E(w) fl E* 
to cover the leaf edge of w. Note that e w ^ e w > holds for distinct unmatched 
vertices w,w' by the maximality of M. Therefore, we obtain \E'\ > \M U {e w \ 
unmatched vertex w £ LEAF(v)}\ = \M\ + (\LEAF(v) — 2\M\) = \LEAF(v)\ — 
\M\ > \LEAF(v)\ — \M*\. □ 

Lemma 2. Let G = (V, E) and T = (' V , F) be a graph and a tree with EC\F = 0, 
and v be a vertex in T which is neither a leaf nor fringe vertex. For the subtree 
T[D(v)\, let E pr i me be the set of edges (w,w') £ E such that {w,w'} = Ch(u) 
for some prime leaf tree T{D(u)\. Then we need at least 

0 v =l\LEAF(v)\-±\M*\ 

edges in E to cover all leaf and fringe edges in T[D(v)}, where M* C E is a 
maximum matching in the graph G{LEAF(v)\ — E pr i me . 

Proof: Let E' C E be an arbitrary subset that covers all leaf edges and fringe 
edges in T[D(v)], and let £) eo / be the set of all edges e = (u, u') £ E with u, u' £ 
LEAF{v). We choose a maximal matching MCE' in the graph (LEAF(v),E'P\ 
(Ei ea f — Eprime)), and let W be the set of unmatched vertices in LEAF(v). Thus, 
IT = \LEAF(v)\ —2\M\. For each unmatched vertex w £ IT, E' must contain 
an edge e w = ( w , z) £ E'nE(w) to cover the leaf edge of w : ; we hx an edge e w even 
if \E' fl E(w) | > 2. By the maximality of M, e w = e w i occurs for some distinct 
w,w' £ IT if and only if w and w' are the children of a prime leaf tree T[D(u)\ 
(i.e., (w, w') £ E pr i m e H E'). We call such a prime leaf tree T{D(u)\ a dangerous 
tree , and denote by Ld the set of leaf vertices of all dangerous trees (hence \Ld\/2 
is the number of all dangerous trees). Thus, we have E' — M D E prime fl E', 
where \E prim e fl E'\ = \Ld\/2. Also the number of edges e w with w £ IT — Ld is 
\{e w | w £ IT — Ld} | = |IT| — \Ld\. Now consider the fringe edge (u, u ') £ F of a 
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dangerous tree T[D(u)\. Let {w,w'} = Ch(u). Note that (w,w') £ E' does not 
cover (u,u'). To cover the fringe edge (u,u'), E' — must contain an 

edge (say, e^) between D(u) = {it, w', w' 1 } and D(u). Clearly e ^ g MUE prime . 

Case-a. \W\ — \L d \ > Hence \\L d \ < \\W\. Since all edges e w with 

w £ W — L d are distinct, we obtain E' 2 MU(E prirne r\E')U{e w \ w £ W — L d }. 
Thus, \E'\ > \M\ + \\L d \ + (\W\ - \L d \) > \M\ + §|W|. 

Case-b. \W\ — \L d \ < d \L d [- Hence \\L d \ > ||W|. There must be at least 
\\L d \ — (|W| — \L d \) = \\L d \ — \W\ dangerous trees T[D(u)} such that no edge e w 
with w G W — L d is incident to T[D(u)\. Hence we need at least |(||L,j| — \W\) = 
\\L d \ — \ \W\ edges to cover the fringe edges of those remaining dangerous trees 
(where we divided \\L d \ — \ W\ by 2 since an edge in E can cover at most two 
such fringe edges). Therefore, we obtain \E'\ > \M\ + \\L d \ + {\W\ — \L d \) + 
{l\L d \-\\W\)>\M\ + l\W\. 

In both cases, we have \E’\ > \M\ + ||W|. By \W\ = \LEAF{v)\ — 2\M\ and 
\M\ < \M*\, it holds \E’\ > |M| + ||W| = l\LEAF(v)\ - \\M\ > \ \LEAF{v)\- 

W M *\- ' ' □ 



4 Approximation Algorithm 

4.1 Outline 

Based on the lower bounds in the previous section, we design an approximation 
algorithm for 2-ECST. The main idea of the algorithm is as follows. We first 
find a subtree T[D(v)] satisfying the following conditions (i) and (ii), where Eif 
denotes the set of edges in E which are incident to a leaf or fringe vertex in 
T[D{v)\. 

(i) every edge in Eif has its end vertices both in T[D(v)\, and 

(ii) E^ covers all edges in T[D(v)\. 

Next we try to choose a small subset E[f C Eif which covers all edges in such 
a subtree T[D(v )] (this is possible by (ii)). Notice that no edge in E — Eif can 
cover a leaf or fringe edge in T[D(v)}; we have to cover all leaf and fringe edges 
in T[D(v)) by using edges in Eif. Hence by Lemma El we need at least (3 V edges 
from Eif just to cover all leaf and fringe edges in T[D(v)\. Thus we obtain a 
performance ratio \E[f\/ f3 v of the size of our solution E[f to the size of a smallest 
subset E*f C Eif that covers all leaf and fringe edges in T[D(v)\. 

It should be noted that, by (i), Eif can cover only edges in T[D(v )], and 
hence any edge not in T[D(v)} must be covered by an edge in E — Eif. Now 
all edges in T[D(v)\ are covered by the current E[f C Eif. To consider the 
remaining problem, we contract all vertices in D(v) into a single vertex, which 
becomes a new leaf vertex, and consider to cover the edges in the resulting tree. 
Then we repeatedly apply this argument until the tree becomes a single vertex. 
(More precisely, to boost up the performance ratio in the above, we treat some 
other reducible cases in section 4.2.) 
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To find a subtree T[D(v)\ satisfying the above (i) and (ii), we introduce 
some more definitions. A subtree T[D(u)) is called l -closed in G if G has no 
edge between LEAF(u) and D(u). Furthermore, the subtree T[D(u)\ is called 
If -closed if G has no edge between LEAF{u ) UFRINGE(u) and D(u). Clearly, 
T = T[D(r)\ is /-closed and //-closed. A subtree T[D(v)} is called minimally If- 
closed if T[D{v)\ is //-closed and there is no proper subtree T[D(u)\ of T[D(v )] 
which is If- closed. An //-closed subtree T[D(v)\ satisfies the above condition (i), 
and it also satisfies the condition (ii) if T[D{y)] is minimally //-closed (since if 
there is an edge (u',v') £ F in T[D(v)) which is not covered by Eif of T[D(v)\, 
then T[D(u')\ would be //-closed). 

4.2 Some reducible leaf trees 

Let u £ V be a leaf vertex, and v be its parent in T. Vertex u is called isolated if 
u is not adjacent (via edges in E(u)) to any other child of v (hence u is isolated 
if \Ch(v)\ = 1). Vertex u is called trivial if E(u) = {(u, u)}; we must use the 
unique edge in E(u) to cover the leaf edge (u,v). Let E(u) = {ei = (u,Vi),e 2 = 
(it, V 2 ), ■ • • , e p = (u, Up)}, where p = |£/(n)| > 2. An edge ej = (u, vf) with Vi = v 
is called redundant if E(u) contains some ej = ( u , vf) with Vj v. If all edges in 
E(u) are multiple edges of (u,v), then we choose an arbitrary edge (say ei) in 
E(u) and call the other edges ej, i = 2, . . . ,p redundant. (Even if G is originally 
simple, our algorithm will repeat contracting some vertices into a single vertex, 
which may produce multiple edges in G.) It is not difficult to see that there is 
an optimal subset E* C E that covers F without using any redundant edge. 

We consider the following three cases, in each of which we can reduce the 
problem size by contracting a vertex subset. 

Case-1. There is an /-closed leaf tree T[D(v)]: In this case, no edge in E 
can cover both an edge ei in T[D(v)) and an edge C 2 not in T[D{v)\. Then we 
can find a smallest set E* C E that covers all leaf edges in T[D(v)} as follows. 
First compute a maximum matching M* in the induced graph G[Ch(v)], and 
let W be the set of unmatched vertices in Ch(v). Next we choose an arbitrary 
edge e w £ E(w) for each unmatched vertex w £ W (where E(w ) 7 ^ 0 by the 2- 
edge-connectivity of T + E). Obviously E* = M* U {e w \ unmatched vertex w £ 
Ch(v)} covers all leaf edges in T[D(v)], and \E*\ = \M*\ + \Ch(v)\ — 2|M*| = 
|C7i(u)| — \M*\. By Lemma ^ | E*\ is the minimum among all subsets of E that 
cover all leaf edges in T[D(v)\. We retain E* as part of solution to cover the 
current T. We then contract all vertices in Ch(v ) U {u} into a single vertex v’ 
both in T and G, and delete any resulting self-loops. The vertex v' becomes a 
new leaf vertex in the resulting T. 

Case-2. There is a leaf tree T[D(v )] such that T[D(v)} is not /-closed and 
there is an isolated leaf vertex u £ Ch(v) (this includes the case of \Ch(v)\ = 1): 
Let I v denote the set of all isolated vertices in Ch{y). For each trivial leaf vertex 
u £ I v (if any), we contract u and v into a vertex both in T and G (retaining 
the edge in E(u) as part of solution to cover the original T). For each non- trivial 
leaf vertex u £ I v (if any), we remove all redundant edges in E(u) from G. Now 
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if there remains an isolated vertex u £ I v , then any edge in E covering the 
leaf edge (u,v) also covers the fringe edge (v,v r ) of v, because E(u) contains no 
redundant edge. For this reason, we contract v and v' into a single vertex both 
in T and G, and delete any resulting self-loops. 

Case-3. There is a leaf tree T[D(v)\ such that T[D[v)\ is not /-closed, Ch(v) 
contains no isolated vertex and \Ch(y)\ = 3: We first remove all redundant edges 
incident tow £ Ch(v). If there is a vertex u £ Ch(v) with | E(u) \ = 1, then choose 
such a vertex u. Now the edge e £ E{u) connects u and another child v! £ Ch(v) 
(since u is not isolated). To cover the leaf edge (u,v), the edge e = (u,u r ) must 
be used. Therefore, we retain the edge (u, u!) as part of solution, and contract 
{«,, u', z>} into a single vertex v both in T and G, deleting any resulting self-loops. 

On the other hand, if |2£(it)| > 2 holds for all u £ Ch(v), then we claim that 
v and its parent v' can be contracted without loss of generality. Let Ch(y ) = 
{u\,U 2 ,u$}. Consider an arbitrary subset E' C E that covers all edges in T. 
Suppose that E' contains no edge between Ch(v) and D(v). That is, all leaf edges 
in T[D(v)\ are covered by (at least) two edges e\ = (v,i,Uj),e 2 = (uj,Uh) € E'. 
Since T[D(v)\ is not /-closed, E contains an edge eg between a vertex u £ Ch(v ) 
and w £ D(y). If there is such an edge eg = (u,, w) (resp., eg = ( Uh , w)), then we 
easily see that E — (E' — e\) U {eo} (resp., E = (E' — e?) U {eo }) covers all edges 
in T. If all such edges eg are incident to Uj, then by \E(ui)\ > 2, E contains an 
edge eg = ( m , Uh)- In this case, E = ( E ' — {ei, e 2 }) U {eo, 63 } covers all edges in 
T. In any case, we can assume that at least one edge between Ch(v) and D{v ) 
is used in E' . For this reason, we contract v and v' into a single vertex both in 
T and G, deleting any resulting self-loops. 

4.3 Covering minimally £/-closed subtrees 

Let T[D(v)\ be a minimally //-closed subtree in T (where we can assume that v 
is not a fringe vertex in T by Case-1 in the previous subsection). Such a T[D{u )] 
always exits, since T = T[D(r)\ is //-closed. Assume that none of Cases-1,2 and 
3 holds for all leaf trees in T[D(v)]. Thus each fringe vertex u in T[D(v)\ satisfies 
that 

(a) the leaf tree T[D(u)] is not /-closed, 

(b) |C7 i(m)| 1 , 3, and 

(c) the induced graph G[Ch(u)] contains at least one edge in E. 

Let Ei f be the set of edges in E which are incident to a leaf or fringe vertex in 
T[D(v)\ (then by the //-closedness, the both end vertices of any edge in Eif are 
contained in T[D(v)}). In this section, we consider how to choose edges from Eif 
to cover all edges in T[D(v)\. Before describing a procedure for choosing such 
edges, some notations are introduced. Let Fi ea f denote the set of leaf edges in 
T[D(v)]. Let Ei e af be the set of all edges e = (■ u , u') £ E with u, v! £ LEAF(v), 
and E prime be the set of edges (w,w') £ E such that {w, w'} = Ch(u ) for some 
prime leaf tree T[D(u)\. The following procedure COVER computes a subset 
Ei C Eif that covers all edges in T[D(v)\, which is minimally //-closed. 
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Procedure COVER 

1. Find a maximum matching M* C E in the graph G[LEAF(v)\ — E pr i me = 
(LEAF(v), Ei ea f — E prime ). Let W be the set of unmatched vertices in 
LEAF(v). We call a prime leaf tree T[D(u )] a dangerous tree if its both 
leaf vertices are unmatched (i.e., Ch(u) C W), and denote by Ld the set of 
leaf vertices of all dangerous trees (hence \Ld\/2 is the number of all danger- 
ous trees). 

2. To cover the leaf edges of unmatched leaf vertices, we choose edges from E 
as follows. 

For each vertex w £ W—Ld, we choose an arbitrary edge e w = (w, z ) € E(w) 
( E(w ) ^ 0 by the 2-edge-connectivity of T + E). For each dangerous tree 
T[D(u)\ , we choose the edge e u = ( w,w ') £ E pr i me with {u>,w/} = Ch(u), 
and denote by M' the set of these edges e u for all dangerous trees T[D(u)\ 
(hence \M'\ = \Ld\/2). The edge set {e w \ w £ W — Ld} U M' covers all leaf 
edges of unmatched leaf vertices in T[D(v)] . ( M * £){e w \ w £ W — L d } U M' 
covers all leaf edges in T[D(v)].) 

3. To cover the all non-leaf edges in T[D(v)\, we choose edges from Eif as 
follows. 

Construct the graph Q = ( LEAF(v ) U FRINGE(v),Fi ea f U M* U M') 
which consists of leaf edges and edges in M* U M' . Denote by 6'i , . . . , C/, 
the connected components of Q (there may be a C t which contains v if 
Ch(v ) n LEAF(v) ^ 0). Note that there are exactly \\Ld\ components Cj 
such that Cj contains exactly two leaf vertices (i.e., such Cj corresponds to 
a dangerous tree). 

For each connected component Ct not containing v in Q , consider the edges 
eCi £ E which connect a vertex in C,; and a vertex not in C,, and choose 
such edge ec* so that lca(eCi) is closest to the root r. (Let eCi be empty if 
Ci does not have such edge.) 

4. Let Ei = M* U {e w \ w £ W — Ld} U M' U {ec; | * = 1, . . . , h} (C Eif). □ 



Lemma 3. Let G = (V, E) and T = (V, F) be a graph and a tree with ECiF = 0 
such thatT+E = (V,FUE) is 2-edge-connected. LetT[D(v)\ be a minimally l f - 
closed subtree satisfying the above (a) — (c). Then the subset E\ C Eif obtained 
by the procedure COVER covers all edges in T[D(y)\. Moreover |Ei| is at most 
~Y times of the smallest number of edges in Eif to cover all leaf and fringe edges 
in T[D(v)\. 

Proof: It is easy to see that Ei covers all leaf edges in T[D(v)\. Assume that 
T[D(v)] contains a non-leaf edge e* = (u*,v*) £ F which is not covered by 
Ei. By the 2-edge-connectivity of T + E, there must be at least one edge e = 
(u,v) £ E between D(u*) and D{u*). By the minimal //-closedness of T[D(v)\, 
there exists such an edge e = (u, v) £ E for which u is a leaf vertex or fringe 
vertex in T[D(u*)]. Let Cj be the connected component containing the u among 
Ci, C 2 , . . . , Ch constructed in Step 3 of COVER. For such Cj (which clearly does 
not contain v), the procedure COVER have chosen an edge ecj among all edges 
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in E incident to Cj so that lca(e.Cj ) is closest to the root r. However, lca(e) 
is closer to r than v (and hence than ?ca(ec 3 )), a contradiction. Therefore, E\ 
covers all edges in T[D(v)). 

Next we estimate the size of Ei = M* U { e w \ w € W — L d } U M' U {e^ | i = 
1, ... ,h}. For a maximum matching M* and the set W of unmatched vertices 
in LEAF(v), we have \W\ = \LEAF(v)\ — 2|M*|. Clearly, \M'\ = \L d \/2 and 
\{e w | w £ W — L d }\ = \W\ — \L d \ by construction. Therefore we have \Ei\ < 
\M*\ + {\W\-\L d \) + \\L d \+h= \M*\ + \W\-±\L d \ + h= \M*\ + (\LEAF(v)\- 
2|M*|) - \\L d \ +h= \LEAF(y)\ - \\L d \ + h- \M*\. 

Now we derive an upper bound on h, which was defined in Step 3 of COVER. 
Recall that there are exactly h\L d \ components Ci corresponding to dangerous 
trees. Let us call such Ci corresponding to a dangerous tree prime. Any non- 
prime component Cj contains a leaf tree having at least four leaf vertices (by 
(b)) or a pair of leaf trees joined by a matching edge in M* . In either case, 
Cj has at least four leaf vertices. Hence there are at most \(\LEAF{y)\ — \L d \) 
non-prime connected components, and we have 

h < \\L d \ + ±{\LEAF{v)\ - \L d \) = l -\LEAF{v)\ + \\L d \. (4.1) 



Moreover any non-prime Cj contains at least one matching edge in M* (note 
that any leaf tree T[D(u)\ with at least four leaf vertices has an edge in G[Ch(u)\ 
by (c)). This means that the number of non-prime components is at most |M*|, 
i.e., 

h-±\L d \<\M*\. (4.2) 

To derive the approximation ratio, note that, by Lemma Q a t least (3 V = 
=j\LEAF(v)\ — ||M*| edges in E are necessary to cover all leaf edges and fringe 
edges in T[D(v)\. Therefore 



J^i 

Pv 



< 



\LEAF(v)\ - \\L d \ + h-\M*\ ^ \LEAF(v)\ - \\L d \ + h-(h- \\L d \) 
l(2\LEAF(v)\-\M*\) ~ \(2\LEAF{v)\-{h-\\L d \)) 

(by (14.21) and since \LEAF(v)\ — \\L d \ + h < 2\LEAF(v)\ holds) 



\LEAF{v)\ 

\(2\LEAF{v)\ - [\\LEAF{v)\ + \\L d \) + \\L d \) 
\LEAF{v)\ ^ 12 

f \ LEAF ( v )\ + ±\ Ld \ - y 



(by (HU) 



□ 



4.4 Entire description 

We are now ready to describe the entire algorithm. For a graph H = (V, E') and 
a subset I C F, we denote by H/X the graph obtained from H by contracting 
X into a single vertex, and delete all the resulting self-loops. 
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APPROX 

Input: A graph G = (F, E ) and a tree T = (F, F) with E fl F = 0 
such that T + F = (F, F U E) is 2-edge-connected. 

Output: A subset E' C F that covers F. 

/* {F„} are computed only for the performance analysis described below. */ 

E' := 0; 

while T contains more than one vertex do 

while there is a leaf tree T[D(v)\ satisfying one of Cases-1,2 and 3 do 
Choose such a leaf tree T[D(v)}\ 
if Case-1 holds for the T[D(v)] then 

Compute a maximum matching M* in G[Ch(v)\, 

and choose an edge e w £ E{vS) for each unmatched vertex w £ Ch(v)\ 

F v \= {all leaf edges in T[D(v)}}; 

E v := M* U {e w | unmatched vertex w £ Ch(v)}; E' := E' U E v ; 

For X = Ch(v) U {u}, let T := T/X and G := G/X 
else if Case-2 holds for the T[D(v)) then 

Let I v be the set of all isolated vertices in Ch(v), and 
I* be the set of trivial leaf vertices u £ I v ; 
if I* ^ 0 then 

F v := {the leaf edges (u,v) for all u £ /*}; 

E v := U u g/»F(w); E' := E' U E v \ 

For X = I* U {u}, let T := T/X and G := G/X; 
if I v - I* v ± 0 then 

Remove redundant edges in E(u) for all u £ I v — /*; 

For the fringe edge (v,v') of v, let T := T/{v,v'} and G := G/{v,v '} 
else if Case-3 holds for the T[D(v)] then 

Remove redundant edges edges in E(u) for all u £ Ch{v)\ 
if there is a vertex u £ Ch(v ) with |F(w)| = 1 then 

Choose such a vertex u and a vertex v! £ Ch(v) — u adjacent to u: 

F v := {(u,v)}; E v := {(u, u 1 )}; E' := E' U E v ; 

For X = { u, u', v}, let T := T/X and G := G/X 
else /* |F(u)| > 2 holds for all u £ Ch(v). */ 

For the fringe edge (v,v') of v, let T := T/{v,v'} and G := G/{u,u'}; 
end /* while */ 

/* Conditions (a)-(c) hold for all leaf trees. */ 

Choose a minimally ^/-closed subtree T[D(y)\\ 

Compute an edge set Fi C E by procedure COVER; 

F v := {all leaf and fringe edges in T[D(v)}}; E v := Fi; E' := E' U E v \ 

For X = D(v), let T := T/X and G := G/X; 
end /* while */ 

Output E' . □ 

Let v\, V 2 , ■ ■ ■ , v p be the sequence of all vertices v such that its subtree T[D(v)] 
has been chosen by APPROX as a leaf tree satisfying one of Cases-1,2 and 3 or a 
minimally //-closed subtrees. For each u,, F v . is a subset of F — {J 1<j . <i F v .. Let 
E* be a minimum subset of E that covers F, and let E*. be a minimum subset 
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of E that covers F Vi . By the choice of F Vl , F V2 , . . . , F Vp , we observe that no edge 
in E can cover two edges e £ F Vi and e! £ F Vj for distinct i,j. From this, it holds 

| E* | > \E* ± | + | E * 2 1 H b \E* \. For each v h E Vi is a subset of E - Ui<j<i E Vj 

and covers F v . . The output E' is then given by E' = E V1 U E V2 U • • • U E Vp . If 
T[D{vi)] has been chosen as a leaf tree, it holds E v . = \E*. |, because this is 
clear for Cases-2 and 3, and is valid for Case-1 by LemmaQJ On the other hand, if 
T[D{vi)\ has been chosen as a minimally Z /-closed tree, we have E Vi < -y \E*.\ 
by LemmaO Therefore, in total, we obtain the desired bound \E'\ < ^\E*\. 

It is not difficult to see that APPROX can be implemented to run in 0(y/nm) 
time, where n = \V\ and m = \E\ + |A|, based on the 0(y/nm) time maximum 
matching algorithm |Hj (the detail is omitted). 

Theorem 1. Given a graph G = (V, E ) and a tree T = (V, F) with E D F = 0 
such that T + E = (V,FUE) is 2-edge-connected , the problem of finding a 
smallest 2-edge-connected spanning subgraph E[ = (V,F U E ') containing T is 
-approximable in 0(^/nm) time, where n = \V\ and m = \E U F\. □ 
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Abstract. As an alternative to the Fibonacci heap, we design a new 
data structure called a 2-3 heap, which supports m decrease-key and 
insert operations, and n delete-min operations in 0(m + nlog n) time. 
The merit of the 2-3 heap is that it is conceptually simpler and easier 
to implement. The new data structure will have a wide application in 
graph algorithms. 



1 Introduction 

Since Fredman and Tarjan 0| published Fibonacci heaps in 1987, there has not 
been an alternative that can support n delete-min operations, and m decrease- 
key and insert operations in 0(m + nlogn) time. Logarithm here is with base 
2, unless otherwise specified. Two representative application areas for these 
operations will be the single source shortest path problem and the minimum 
cost spanning tree problem. Direct use of these operations in Dijkstra’s p] and 
Prim’s .7!) algorithms with a Fibonacci heap will solve these two problems in 
0(m-|- nlogn) time. A Fibonacci heap is a generalization of a binomial queue 
invented by Vuillemin @. When a key of a node v is decreased, the subtree 
rooted at v is removed and linked to another tree at the root level. If we perform 
this operation many times, the shape of a tree may become shallow, that is, the 
number of children from a node may become too many due to linkings without 
adjustment. If this happens at the root level, we will face a difficulty, when the 
node with the minimum is deleted and we need to find the next minimum. To 
prevent this situation, they allow loss of at most one child from any node. If 
one more loss is required, it will cause what is called cascading cut. This toler- 
ance bound will prevent the degree of any node in the heap from getting more 
than 1.44 log n. The constant is the golden ratio derived from the Fibonacci se- 
quence. Since this property will keep the degree in some bound, let us call this 
’’horizontal balancing”. 

In the area of binary search trees, there are two well-known balanced tree 
schemes; the AVL tree L IJ and the 2-3 tree j2]. When we insert or delete items 
into or from a binary search tree, we may lose the balance of the tree. To prevent 
this situation, we restore the balance by modifying the shape of the tree. As we 
control the path lengths, we can view this adjustment as vertical balancing. The 
AVL tree can maintain the tree height to be 1.44 log n whereas the 2-3 tree will 
keep this to be log 77. As an alternative to the Fibonacci heap, we propose a 
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new data structure called a 2-3 heap, the idea of which is borrowed from the 
2-3 tree and conceptually simpler than the Fibonacci heap. The degree of any 
node in the 2-3 heap is bounded by log n, better than the Fibonacci heap by a 
constant factor. While the Fibonacci heap is based on binary linking, we base 
our 2-3 heap on ternary linking; we link three roots of three trees in increasing 
order according to the key values. We call this path of three nodes a trunk. 
We allow a trunk to shrink by one. If there is requirement of further shrink, 
we make adjustment by moving one or two subtrees from nearby positions. This 
adjustment may propagate, prompting the need for amortized analysis. The word 
’’potential” used in [B| is misleading. It counts the number of nodes that lost one 
child. This number reflects some deficiency of the tree, not potential. Thus we 
use the word ’’deficit” for amortized analysis. We mark the trunk if it already 
lost one node and its corresponding tree. We define the deficit of the 2-3 heap to 
be the number of marked trunks. Amortized time for one decease-key or insert 
is shown to be 0(1), and that for delete-min to be O(logn). 

The concept of r- ary linking is similar to the product of graphs. When we 
make the product of G x H of graphs G and H , we substitute H for every 
vertex in G and connect corresponding vertices of H if an edge exists in G. See 
Bondy and Murty J3J, for example, for the definition. In the product of trees, 
only corresponding roots are connected. The 2-3 heap is constructed by ternary 
linking of trees repeatedly, that is, repeating the process of making the product 
of a linear tree and a tree of lower dimension. This general description of r- ary 
trees is given in Section 2. The precise definition of 2-3 heaps is given in Section 
3. The description of operations on 2-3 heaps is given in Section 4. We also 
give amortized analysis of those operations. In Section 5, we consider several 
problems in implementation, and also some practical considerations for further 
speed up. Section 6 concludes this report. Note that our computational model 
is comparison-based. If we can use special properties of key values, there are 
efficient data structures, such as Radix-heaps [0j. 

2 Polynomial of trees 

We define algebraic operations on trees. We deal with rooted trees in the follow- 
ing. A tree consists of nodes and branches, each branch connecting two nodes. 
The root of tree T is denoted by root{T). A linear tree of size r is a liner list of r 
nodes such that its first element is regarded as the root and a branch exists from 
a node to the next. The linear tree of size r is expressed by bold face r. Thus a 
single node is denoted by 1, which is an identity in our tree algebra. The emplty 
tree is nenoted by 0, which serves as the zero element. A product of two trees 
S and T, P = ST, is defined in such a way that every node of S is replaced by 
T and every branch in S connecting two nodes u and v now connects the roots 
of the trees substituted for u and v in S. Note that 2 * 2 4, for example, and 

also that ST ^ TS in general. The symbol ” * ” is used to avoid ambiguity. 

The number of children of node v is called the degree of v and denoted by 
deg(v). The degree of tree T, deg{T), is defined by deg(root{T)). A sum of two 
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trees S and T, denoted by S + T, is just the collection of two trees S and T if 
deg(T ) ^ deg(S). A polynomial of trees is defined next. Since the operation of 
product is associative, we use the notation of r l for the products of i r’s. An 
r- ary polynomial of trees of degree k — 1, P, is defined by 

P = a fc _ir fe_1 + ... + a x r + a 0 (1) 

where a.; is a linear tree of size a,; and called a coefficient in the polynomial. Let 
|P| be the number of nodes in P and a, = a*. Then we have |P| = afc_ir fe_1 + 
... + air + a 0 . We choose aj to be 0 < a,; < r — 1, so that n nodes can be expressed 
by the above polynomial of trees uniquely, as the k digit radix-r expression of 
n is unique with k = [log r (n + 1)]. The term a,r * is called the +th term. We 
call r* the complete tree of degree i. Let the operation ”• ” be defined by the 
tree L = S • T for trees S and T. The tree L is made by linking S and T in 
such a way that root(T) is connected as a child of root(S). Then the product 
r' = rr^ 1 is expressed by 

r* = r l_1 • ... • r* _1 (r times) (2) 

The whole operation in (2) is to link r trees, called an i-th r- ary linking. The 
path of length r — 1 created by the r- ary linking is called the i-th trunk of the tree 
r', which defines the i-th dimension of the tree in a geometrical sense. The j-tli 
r i_1 in (2) is called the j-th subtree on the trunk. The path created by linking a* 
trees of ry in form (1) is called the main trunk of the tree corresponding to this 
term. A polynomial of trees is regarded as a collection of trees of distinct degrees, 
which are formed by repeating the linking process. We next define a polynomial 
queue. An r-nomial queue is an r- ary polynomial of trees with a label label{v) 
attached to each node v such that if u is a parent of v, labeliu) < labeKy). A 
binomial queue is a 2-nomial queue. 

Example 1. A polynomial queue with an underlying polynomial of trees P = 
2 * 3 2 + 2*3 + 2 is given below. 




Fig. 1. Polynomial of trees with r = 3 



Each term a,;r, in form (1) is a tree of degree i + 1 if a,; >1. One additional 
degree is caused by the coefficient. The merging of two linear trees r and s is to 
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merge the two lists by their labels. The result is denoted by the sum r + s. The 
merging of two terms a.iXi and a'ji \ is to merge the main trunks of the two trees 
by their labels. When the roots are merged, the trees underneath are moved 
accordingly. If a* + a' < r, we have the merged tree with coefficient a , + a'. 
Otherwise we have a carry tree r* +1 and the remaining tree with the main trunk 
of length a t + a\ — r. The sum of two polynomial queues P and Q is made by 
merging two polynomial queues in a very similar way to the addition of two 
radix-r numbers. We start from the 0-tlr term. Two *-tlr terms from both queues 
are merged, causing a possible carry to the (i + l)-th terms. Then we proceed 
to the (i + l)-th terms with the possible carry. 

An insertion of a key into a polynomial queue is to merge a single node 
with the label of the key into the 0-th term, taking 0(r log r n) time for possible 
propagation of carries to higher terms. Thus n insertions will form a polynomial 
queue P in 0(nr\og r n) time. The value of k in form (1) is 0(log r n) when 
we have n nodes in the polynomial of trees. We can take n successive minima 
from the queue by deleting the minimum in some tree T, adding the resulting 
polynomial queue Q to P — T, and repeating this process. This will sort the n 
numbers in 0(nr\og r n) time after the queue is made. Thus the total time for 
sorting is 0(nr\og r n). In the sorting process, we do not change key values. If 
the labels are updated frequently, however, this structure of polynomial queue is 
not flexible, prompting the need for a more flexible structure in the next section. 

3 2-3 heaps 

We linked r trees in form (2). We relax this condition in such a way that the 
number of trees linked is from l to r. Specifically an (l,r)~ tree T(i) of degree i 
is formed recursively by 

T(0) = a single node 

T(i) = T\(i — 1) • ... • T m [i — 1) (to is between l and r) (3) 

Note that m varies for different linkings. The subscripts of T(i) are given to 
indicate different trees of degree i — 1 are used. Note that the shape of an (l, r)- 
tree T(i) is not unique for n such that |T(i)| = n. We say root{Ti(i — 1)) is the 
head node of this trunk. The dimension of non-head nodes is i — 1 and that of the 
head node is i or higher, depending on further linkings. We omit a subscript for 
T(i)- T{i) sits for an (l,r)~ tree of degree i. In this context, we sometimes refer 
to T(i) as a type of tree. Then an extended polynomial of trees, P, is defined by 

P = — 1) + ... + a!T(l) + a 0 (4) 

The main trunk and the Ptlr trunk in each term of (4) are similarly defined to 
those for (1). So is the ji-th subtree in the trunk. Let us assign labels with nodes 
in the tree in a similar way to the last section. That is, when the ?n-ary linking 
is made, the roots are connected in non-decreasing order of labels. Then the 
resulting polynomial is called an (^,r)-heap. When l = 2 and r = 3, we call it a 
2-3 heap. We refer to the trees in (4) and their roots as those at the top level, 
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as we often deal with subtrees at lower levels and need to distinguish them from 
the top level trees. The sum P + Q of the two 2-3 heaps P and Q is defined 
similarly to that for polynomial queues. Note that those sum operations involve 
computational process based on merging. 

Example 2. P = 2T(2) + 2P(1) + 2T(0). A trunk is marked thick if it has only 
two nodes. 





Lemma 1. The number of nodes in 2-3 heap P in form (3), \P\, satisfies that 
2 k - 1 < \P\ < 3 fc - 1. 

^From this we see k = O(logn). We informally describe delete- min, insertion, 
and decrease-key operations for a 2-3 heap. Precise definitions will be given in 
the next section. Let the dimension of node v be i, that is, the trunk of the 
highest dimension on which node v stands is the z-th. Suppose v is not at the 
top level. Then v is not the head node of the z-th trunk, which connects 2 or 3 
trees of type T(i — 1). Let tree(v ) be one of these trees rooted at v. We define the 
work space for v to be a collection of nodes on the z-th trunk of v, the (i + l)-th 
trunk of the head node of v, and the other z-th trunks whose head nodes are on 
the ( i + l)-th trunk. The work space has 4 to 9 nodes. Let the head node of the 
work space be the node at the first position of the (z + l)-th trunk. In this paper 
the words ’’key” and ’’label” are used with the same meaning. 

Example 3. Let us denote the node with label x by node(x ) in Example 2. The 
work space for node(18) is {node{ 3), node(13), node( 21), node(ll), node( 18), 
node( 30), node(26), node(29)}. The head node of this work space is node( 3). 
The work space for node{ 9) is in higher dimensions and given by {node{ 2), 
node( 8), node( 9), node{ 3), rcode(ll), node(26)}. The head node is node(2). 

Delete-min: Find the minimum by scanning the roots of the trees. Let T(z) 
have the minimum at the root and Q be the polynomial resulting from T(z) by 
removing the root. Then merge P — T(i) and Q , i.e., (P — T(z)) + Q. 

Marking of a trunk: A trunk is marked or unmarked if it has two or three 
nodes respectively. 
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Insertion: Perform T + v, where we insert v with its key into the 2-3 tree T. 
Here v is regarded as a 2-3 tree with only a term of type T(0). 

Removal of a tree: We do not remove tree(v) for a node v if it is a root at the 
top level. Suppose we remove tree(v ) of type T(i — 1) for a node v. Consider the 
two cases where the size of the work space is greater than 4, and it is equal to 4. 
We start with the first case. Let the i-th trunk of node v be (u, v, w) or (u, w, v). 
Then remove tree(v ) and shrink the trunk. If the trunk is (u, v), remove tree(v). 
And we would lose this trunk. To prevent this loss, we move one or two trees of 
type T(i — 1) from the work space. 

Let the size of the work space be 4. Remove tree(v) and rearrange the re- 
maining three nodes in such a way that two will come under the head node of the 
work space to form the 1-th trunk. Then we recover the i-tli trunk to be of length 
2, but lose the (i + l)-th trunk. Our work proceeds to a higher dimension, if it 
exists. Otherwise stop. Note that during the above modifications of the heap, we 
need to mark and unmark trunks, and need to compare key values of nodes to 
find out the correct positions for placing trees. 

Decrease-key: Suppose the key of node v has been decreased. If v is not at the 
top level, remove tree(v), and insert it to the j-th term at the top level with the 
new key, where j = deg(tree(v)). If v is at the top level, do nothing after you 
decrease the key. 

Example 4- In Example 2, we name the node with label x by node(x). Suppose 
we decrease labels 6 to 4, and 29 to 14. Then we have the following T = 1T(3) + 
1T(0). 




We first remove node( 6), causing the move of node( 7) to the child position 
of node{ 2) and the marking of the trunk between node( 2) and node{ 7). The new 
node node( 4) is inserted into 2T(0), resulting in T(l) with node{ 8) and node( 19) 
and carrying over to 2T(1) to cause insertion. Then the newly formed T( 2) will 
be carried to 2T(2), resulting in T(3). For the second decrease-key, we have a 
new node ?rode(14). Since the trunk is already marked, node{ 30) is moved to the 
child position of node( 26), and the trunks between node{ 11) and node(18), and 
node( 26) and node( 30) are marked. 
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4 Analysis of 2-3 trees 

For removal of a tree, let us classify the situation using parts of the tree structure. 
In the following figures, only work space is shown. Each node can be regarded 
as a tree of the same degree for general considerations. The left-hand side and 
the right-hand side are before and after conversion. The trunk going left-down 
is a trunk of i-tlr dimension (z-th trunk for short), and that going right-down is 
a trunk of ( i + l)-th dimension. We have two or three trunks of z-tli dimension 
in the following figures. By removing a node and shrinking a trunk, we create a 
vacant position, which may or may not be adjusted. We classify the situation into 
several cases depending on the size w of the work space. In the following figures 
the z-tli trunks are arranged in non-decreasing order of lengths for simplicity. 
Other cases are similar. 

Case 1. w = 9. The removal of any of the six black nodes will bring the same 
new shape by adjusting the heap within the work space. We increase the number 
of marked trunks by one and spend no comparison. The case for w = 8 is similar, 
except for the case where v on a marked trunk is removed. In this case, we can 
rearrange the heap within the work space with one comparison and increase the 
marked trunks by one. See Fig, 4. 





Fig. 4. The case of w = 9 



Case 2. w = 7. We increase marked trunks by one and spend no comparison. 
See Fig. 5. 





Fig. 5. The case of w = 7 



Case 3. w = 7 We decrease marked trunks by one and spend at most one 
comparison. See Fig. 6. 
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Fig. 6. Another case of w = 7 



Case 4. w = 6. We spend at most one comparison and decrease marked trunks 
by one. See Fig. 7. 





Fig. 7. The case of w = 6 



Case 5. w = 6. We increase the number of marked trunks by one and spend 
no comparison. See Fig. 8. 





Fig. 8. Another case of w — 6 



Case 6. w = 5. We increase the number of marked trunks by one and spend 
at most one comparison. See Fig. 9. 

Case 7. w = 4. The trunks of degree i and degree i + 1 are both marked. 
We make an unmarked i - th trunk for the head node and the situation becomes 
the loss of a node at the (i + l)-th trunk. Make-up will be made in the work 
space defined by the (i + l)-th trunk and the (i + 2)-th trunk. The make-up 
process stops in cases 1-6, or if no higher trunk exists. The (i + 2)-th trunk is 
drawn by a dotted line, and the by-gone (i + l)-th trunk is drawn by a broken 
line at the right-hand side. We lose three marked trunks and spend at most one 
comparison. See Fig. 10. 

Next we do analysis of top level insertions. Suppose we insert a tree of type 
T(i) into the term a* T(i) at the top level. We have three cases. 
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Fig. 10. The case of w = 4 



Case A. = 0 . We simply put the tree in the correct position. 

Case B. aj = 1. We can form a new 2 T(i) with one comparison and mark 
the new main trunk. 

Case C. a,; = 2. We make T(i + 1) with two comparisons and decrease marked 
trunks by one. Then proceed to the insertion at a l+ iT(i + l). 

We analyze the computing time by the number of comparisons between key 
values, based on amortized analysis. Other times are proportional to it. Define 
the deficit of a 2-3 heap by the number of marked trunks times 2. We regard the 
deficit value as the debt of comparisons. Suppose we perform n delete- min oper- 
ations and m decrease-key and insert operations. The actual time and amortized 
time for the i-th operation are denoted by t, and a*, where cii = U + T) — Fi-±, 
and Fi is the deficit after the i-th operation. Let the total number of operation 
be N. Since Aa, = Sti + Fj\; — Fq, and the deficits are assumed to be zero at the 
beginning and end, the total actual time is equal to the total amortized time. 
Amortized time for delete-min: It takes 0(log n) time to find the minimum 
and break apart the subtrees under the root with the minimum. The merging 
process for those subtrees at the top level takes O(logn) time. This process in- 
creases the deficit by O(logn). Thus one delete-min operation’s amortized time 
is O(logn). The worst-case time is also O(logn). 

Amortized time for decrease-key: It takes 0(1) time for decreasing the 
value of the key. After that, we perform various operations described above, all 
of which are bounded by 3, meaning that one decrease-key or insert operation’s 
amortized time is 0(1). Note that the amortized times for case 7 and case C 
above are not greater than 0. 

Amortized time for insertion: We insert a new node to the 0-th term of the 
top level. Thus the amortized time is 0(1). 

If we perform n delete-min operations, and m decrease-key and insertion 
operations, the total time is now bounded by 0(m + n\ogn). Thus we can solve 
the single source shortest path problem and the minimum cost spanning tree 
problem in 0(m + nlogn) time in a similar setting to (OJ . 
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5 Practical considerations 

For the data structure of a 2-3 heap, we need to implement it by pointers. For 
the top level trees, we prepare an array of pointers of size d = [log(n + 1)], each 
of which points to the tree of the corresponding degree. Let a node v’s highest 
trunk be the *-th. The data structure for node v consists of integer variables 
key and dim = i, a pointer to the head node of the i-tli trunk, and an array of 
size d , whose elements are pairs (second, third). The second of the j-th element 
of the array points to the root of the second node on the j-th trunk of v. The 
third is to the third node. It also has a Boolean array of size d. The j-th element 
shows whether the j-th trunk is marked or not. With this data structure, we 
can explore the work space for v. If we prepare the fixed size d for all the nodes, 
we would need 0(?tlogn) space. By implementing arrays by pointers, we can 
implement our algorithm with 0(n) space, as is done in the Fibonacci heap, 
althogh this version will be less time-efficient. 

6 Concluding remarks 

We developed an alternative to the Fibonacci heap. If we measure the complexity 
of n delete-min’s, and m decrease-key’s and insert’s by the number of compar- 
isons, and showed it to be 0(m + nlogn). We will need to analyze the constant 
factors in this complexity and those of the Fibonacci heap to determine which 
of the 2-3 heap and Fibonacci heap is more efficient. The method for modifying 
the heap when a node on a marked trunk is removed is not unique. The method 
in Section 4 is designed to make as many unmarked trunks as possible to keep 
the packing ratio of the 2-3 heap better. To say this is the best method, we will 
need further study. The author expresses thanks to the referees who read the 
manuscript carefully and suggested many improvements. 
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Abstract. We present results related to satisfying shortest path queries 
on a planar graph stored in external memory. In particular, we show how 
to store rooted trees in external memory so that bottom-up paths can be 
traversed I/O-efficiently, and we present I/O-efficient algorithms for tri- 
angulating planar graphs and computing small separators of such graphs. 
Using these techniques, we can construct a data structure that allows for 
answering shortest path queries on a planar graph I/O-efficiently. 



1 Introduction 

Motivation. Answering shortest path queries in graphs is an important and well 
studied problem. Applications include communication systems, transportation 
problems, scheduling, computation of network flows, and geographic information 
systems (GIS). Typically, an underlying geometric structure is represented by 
an equivalent combinatorial structure, which is often a weighted, planar graph. 

Model of Computation. In many applications data sets are too large to fit into 
the main memory of existing machines. In such cases, conventional internal mem- 
ory algorithms can be inefficient, accessing their data in a random fashion, and 
causing many data transfers between internal and external memory. This I/O- 
bottleneck is becoming more significant as parallel computing gains popularity 
and CPU speeds increase, since disk speeds are not keeping pace. Several com- 
putational models for estimating the 1/ O-efficiency of algorithms have been de- 
veloped mm- We adopt the parallel disk model PDM pm as our model of 
computation for this paper due to its simplicity, and the fact that we consider 
only a single processor. 

In the PDM, an external memory , consisting of D disks, is attached to a 
machine with memory size M data items. Each of the disks is divided into 
blocks of B consecutive data items. Up to D blocks, at most one per disk, can 
be transferred between internal and external memory in a single I/O operation. 
The complexity of an algorithm is the number of I/O operations it performs. 

* For details see m 
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